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TITLE OF THE INVENTION 
INFORMATION PROCESSING APPARATUS, ITS CONTROL METHOD, 
AND STORAGE MEDIUM 



FIELD OF THE INVENTION 
The present invention relates to an information 
processing apparatus, its control method, and a storage 
medium and, more particularly, to an information 
processing apparatus which creates an electronic 
document using images sensed and stored by a video 
input device, its control method, and a storage medium. 

BACKGROUND OF THE INVENTION 
An increasing number of users connect to the 
Internet these days. Such users can build their home 
pages on the Internet as information resources in place 
of merely accessing the Internet. Also, networks in 
each company and in related companies, i.e., so-called 
intranets, have prevailed. 

Upon advertising a given shop, it is a common 
practice to use newspapers (inserted bills), magazines, 
or broadcast. However, publishing home pages can 
achieve resource savings, and such approach to 
advertising a given shop will become increasingly 
prevalent in the future. Even small shops are 
projected to use such services. 



Upon updating a home page, the user must edit his 
or her home page on the terminal, and then must upload 
the edited result to a WWW server. 

Although it is not common to update a personal 
5 home page so frequently, if a need to update a home 

page frequently arises, such works are complicated and 
result in another factor of cost increase. 

For example, a home page that displays menu items 
of a cafeteria will be examined. In this case, when a 
10 menu item has changed, it is required to quickly update 
an open image list page. More specifically, the 
following processes will be done. That is, an image of 
each menu item is sensed using a digital camera or the 
like, and that image data is captured using an HTML 
15 document editor or the like and is edited. Finally, 
the obtained data is then uploaded to the WWW server. 

Therefore, as soon as a menu item has changed, 
one must contact an editor to ask him or her to start 
editing. In other words, the editor must stand by 
20 while a menu item change is likely to occur, resulting 
in high running cost. Also, updating is troublesome. 
Furthermore, it is not easy to precisely lay out an 
object to be sensed in correspondence with the image 
sensing position. 
25 If there are documents or images which are not to 

be open to the public, the operator must examine such 



documents or images one by one whether to open them to 
the public. 

SUMMARY OF THE INVENTION 
5 The present invention has been made in 

consideration of the above problems and has as its 
object to provide an information processing apparatus 
which can easily update an image contained in a 
document which is submitted on the network, its control 
10 method, and a storage medium. 

In order to achieve the above object, an image 
processing apparatus according to the present invention 
comprises the following arrangement. That is, an 
information processing apparatus for submitting 
15 document information including an image via a network, 
comprises image input means, schedule storage means for 
storing input schedule information of the image input 
means, image storage means for storing an image 
obtained in accordance with the schedule information, 
20 and document creation means for creating new document 
information by substituting an image in the document 
information by the image stored in the image storage 
means . 

It is another object of the present invention to 
25 provide an information processing apparatus which can 

easily update an image contained in a document which is 
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submitted on the network, and can make an image of an 
object to be sensed fall within the field range the 
user intended without precisely designating the image 
sensing position, its control method, and a storage 
5 medium. 

In order to achieve the above object, an image 
processing apparatus according to the present invention 
comprises the following arrangement. That is, an 
information processing apparatus for submitting 

10 document information including an image via a network, 
comprises image input means, schedule input means for 
inputting schedule information pertaining to image 
capture of the image input means, correction means for 
correcting the schedule information input by the 

15 schedule input means, image storage means for storing 
an image obtained in accordance with new schedule 
information corrected by the correction means, and 
document creation means for creating document 
information on the basis of an image stored in the 

20 image storage means. 

It is still another object of the present 
invention to provide an information processing 
apparatus which can easily update an image contained in 
a document which is submitted on the network, and can 

25 automatically make it open on the network, its control 
method, and a storage medium. 



In order to achieve the above object, an image 
processing apparatus according to the present invention 
comprises the following arrangement. That is, an 
information processing apparatus for submitting 
5 document information including an image via a network, 
comprises image input means, schedule input means for 
inputting schedule information pertaining to image 
capture of the image input means, correction means for 
correcting the schedule information input by the 

10 schedule input means, image storage means for storing 
an image obtained in accordance with new schedule 
information corrected by the correction means, document 
creation means for creating document information on the 
basis of an image stored in the image storage means, 

15 authentication means for authenticating if a candidate 
document is submitted onto the network, and submission 
control means for controlling submission of the 
candidate document onto the network in accordance with 
a predetermined condition irrespective of an 

20 authentication result of the authentication means. 

It is still another object of the present 
invention to provide an information processing 
apparatus which can easily update an image contained in 
a document which is submitted on the network, and can 

25 set an image sensed under a required image sensing 



condition to be closed, its control method, and a 
storage medium. 

In order to achieve the above object, an image 
processing apparatus according to the present invention 
5 comprises the following arrangement. That is, an 
information processing apparatus for submitting 
document information including an image via a network, 
comprises image input means, schedule storage means for 
storing input schedule information of the image input 

10 means, image storage means for storing an image 

obtained in accordance with the schedule information, 
document creation means for creating new document 
information by substituting an image in the document 
information by the image stored in the image storage 

15 means, and setting means for setting a condition for 

inhibiting an image, which is input by the image input 
means and is stored, from being published, wherein an 
image that satisfies the condition set by the setting 
means is determined not to be published, and is 

20 excluded from images to be submitted. 

Other features and advantages of the present 
invention will be apparent from the following 
description taken in conjunction with the accompanying 
drawings, in which like reference characters designate 

25 the same or similar parts throughout the figures thereof. 



BRIEF DESCRIPTION OF THE DRAWINGS 
Fig. 1 is a block diagram showing the arrangement 
of a camera server according to the first embodiment of 
the present invention; 
5 Fig. 2 is a diagram showing the system 

arrangement to which a camera server of each embodiment 
is applied; 

Fig. 3 shows a user interface with which the user 
sets an image sensing schedule of the camera server in 
10 the first embodiment; 

Fig. 4 is a chart showing the flow of image edit 
processes in the first embodiment ; 

Fig. 5 is a chart for explaining the flow of page 
authentication processes in the first embodiment; 
15 Fig. 6 is a flow chart showing the processing 

seguence of an operation setup program in the first 
embodiment ; 

Fig. 7 is a flow chart showing the processing 
sequence of a video recording execution program in the 
20 first embodiment ; 

Fig. 8 is a flow chart showing the processing 
sequence of a candidate edit program in the first 
embodiment ; 

Fig. 9 is a flow chart showing the processing 
25 sequence of a page select program in the first 
embodiment ; 



Fig. 10 is a block diagram showing the 
arrangement of a camera server according to the second 
embodiment of the present invention; 

Fig. 11 is a chart showing the flow of image edit 
5 processes in the second embodiment; 

Fig. 12 is a flow chart showing the processing 
sequence of a candidate edit program in the second 
embodiment; 

Fig. 13 is a view showing the contents of a 
10 substitute table in the second embodiment; 

Fig. 14 shows a display example in an image 
select process in the second embodiment; 

Fig. 15 is a block diagram showing the 
arrangement of a camera server according to the third 
15 embodiment of the present invention; 

Fig. 16 shows a user interface with which the 
user sets an image sensing schedule of the camera 
server in the third embodiment; 

Fig. 17 is a flow chart showing the processing 
20 sequence of an upload program in the third embodiment; 

Fig. 18 shows an example of a deleted image list 
page in the third embodiment; 

Fig. 19 is a block diagram showing the 
arrangement of a camera server according to the fourth 
25 embodiment of the present invention; 



Fig. 20 shows the storage state of image data in 
an auxiliary storage device in the fourth embodiment; 

Fig. 21 shows a list of displacement camera angle 
information generated from camera angle information in 
5 the fourth embodiment; 

Fig. 22 shows an example of displacement camera 
angle setup window in the fourth embodiment; 

Fig. 2 3 is a flow chart showing the operation of 
a video recording execution program in the fourth 
10 embodiment ; 

Fig. 24 is a chart showing the flow of image edit 
processes in the fourth embodiment; 

Fig. 25 is a flow chart showing the processing 
contents of a candidate edit program in the fourth 
15 embodiment ; 

Fig. 26 shows an example of a substitute image 
select window in the fourth embodiment; 

Fig. 27 shows an example of an edit window in the 
fifth embodiment of the present invention; 
20 Fig. 28 is a flow chart showing the processing 

contents of a candidate edit program in the fifth 
embodiment ; 

Fig. 29 is a flow chart showing the operation of 
a video recording execution program in the fifth 
2 5 embodiment; 



Fig. 30 is a flow chart showing the processing 
contents of a candidate edit program in the fifth 
embodiment; 

Fig. 31 shows an example of an edit window in the 
5 fifth embodiment ; 

Fig. 32 is a view for explaining the operation 
setups for setting an image sensing schedule of a 
camera server in the sixth embodiment; 

Fig. 33 shows an example of a window upon 
10 creating an initial candidate page in the sixth 
embodiment ; 

Fig. 34 is a flow chart showing the contents of 
an initial candidate page creation process in the sixth 
embodiment ; 

15 Fig. 35 is a chart showing the flow of image edit 

processes in the eighth embodiment; 

Fig. 36 is a flow chart showing the processing 
contents of a candidate edit program in the eighth 
embodiment ; 

20 Fig. 37 is a block diagram showing the 

arrangement of a camera server according to the ninth 
embodiment of the present invention; 

Fig. 38 is a view for explaining the operation 
setups for setting an image sensing schedule of the 

25 camera server in the ninth embodiment; 



Fig. 39 is a flow chart for explaining the flow 
of an operation setup program in the ninth embodiment; 

Fig. 40 is a flow chart for explaining the flow 
of a page select program in the ninth embodiment; 
5 Fig. 41 is a block diagram showing the 

arrangement of a camera server according to the 10th 
embodiment of the present invention; 

Fig. 42 is a flow chart showing the processing 
contents of a candidate edit program in the 10th 
10 embodiment; 

Fig. 43 shows the contents of a candidate 
importance list in the 11th embodiment of the present 
invention; 

Fig. 44 is a flow chart showing the processing 
15 contents of a page select program in the 11th 
embodiment ; 

Fig. 45 is a block diagram showing the 
arrangement of a camera server in the 11th embodiment; 
Fig. 46 shows the contents of a candidate 
20 importance list in the 11th embodiment ; 

Fig. 47 is a block diagram showing the 
arrangement of a camera server according to the 12th 
embodiment of the present invention; 

Fig. 48 is a chart showing an example of the flow 
25 of image edit process in the 12th embodiment; 



Fig. 49 is a flow chart showing the processing 
contents of a candidate edit program in the 12th 
embodiment; 

Fig. 50 shows the contents of a candidate 
5 importance list in the 12th embodiment; 

Fig. 51 is a block diagram showing the 
arrangement of a camera server according to the 13th 
embodiment of the present invention; 

Fig. 52 is a chart showing an example of the flow 
10 of image edit processes in the 13th embodiment; 

Fig. 53 is a flow chart showing the processing 
contents of a candidate edit program in the 13th 
embodiment ; 

Fig. 54 shows the contents of a candidate 
15 importance list in the 13th embodiment ; 

Fig. 55 shows the contents of an image importance 
list in the 13th embodiment; 

Fig. 56 is a block diagram showing the 
arrangement of a camera server according to the 14th 
20 embodiment of the present invention; 

Fig. 57 is a chart showing an example of the flow 
of image edit processes in the 14th embodiment; 

Fig. 58 is a flow chart showing the contents of a 
candidate list display process in the 14th embodiment; 



Fig. 59 is a block diagram showing the 
arrangement of a camera server according to the 15th 
embodiment of the present invention; 

Fig. 60 shows an example of publication 
5 inhibition setups in the 15th embodiment; 

Fig. 61 is a flow chart showing the contents of a 
publication inhibition setup process in the 15th 
embodiment; 

Fig. 62 is a chart showing an example of the flow 
10 of image edit processes in the 15th embodiment; 

Fig. 63 is a flow chart showing the contents of a 
candidate edit process in the 15th embodiment; 

Fig. 64 shows an example of the contents of a 
publication list in the 15th embodiment; 
15 Fig. 65 is a block diagram showing the 

arrangement of a camera server according to the 16th 
embodiment of the present invention; 

Fig. 66 is a flow chart showing the contents of a 
candidate edit process in the 16th embodiment; 
20 Fig. 67 shows an example of the contents of an 

image importance list in the 16th embodiment; and 

Fig. 68 shows an example of a page created by the 
17th embodiment of the present invention. 

25 DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS 
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Preferred embodiments of the present invention 
will be described in detail hereinafter with reference 
to the accompanying drawings. 
[First Embodiment] 
5 Fig. 2 shows the arrangement of a system used in 

each embodiment. Referring to Fig. 2, reference 
numeral 100 denotes a camera server which serves as an 
image edit system; and 110, a network {the Internet or 
the like) . Reference numeral 202 denotes a client 

10 connected to the network 110; and 203, a WWW (World 
Wide Web) server that offers WWW services. 

In this embodiment, a home page (to be simply 
referred to as a page hereinafter) is edited/created on 
the basis of images sensed/recorded by the camera 

15 server 100, and is uploaded to the WWW server 203. 
When the user accesses the WWW server 203 via the 
client 202, he or she can browse through images (pages) 
sensed by the camera server 100. 

Fig. 1 shows the arrangement of the camera server 

20 100 which serves as an image edit system in the 
embodiment . 

In the camera server 100, a memory 101 for 
storing programs and data required for starting up the 
system, a central processing unit 102 for controlling 

25 arithmetic operations and processes, a CRT 103 as a 
display device for displaying characters, symbols, 



images, and the like, an image input interface 104 for 
capturing images, a serial interface 105 for exchanging 
control commands and the like, an auxiliary storage 
device (hard disk or the like) 106 for saving data, a 
5 keyboard device 107 for inputting characters and the 
like, a pointing device 108 used to point to a 
displayed character or the like using a cursor, and a 
network communication interface 109 for exchanging data 
among many locations are connected via a bus 112. 

10 The camera server 100 is connected to the network 

110 via the network communication interface 109. 

A camera 111 is connected to the image input 
interface (VC) 104 for capturing images and the serial 
interface (RS) 105 for receiving control commands and 

15 the like, and sending status signals (current status 
and the like) . That is, the image sensing conditions 
of the camera 111 (pan angle, tilt angle, zoom ratio, 
exposure, and the like) are controlled by sending 
commands via the RS 105. An image sensed by the camera 

20 111 is received by the VC 104, and is captured as 

digital data. A program associated with this control 
is stored in the memory 101. 

The memory 101 mainly stores an operation setup 
program 113, video recording execution program 114, 

25 candidate edit program 115, and page select program 116. 



Note that these programs may be stored in a 
storage medium (not shown) , and may be loaded and 
executed on the memory 101 via a drive device (not 
shown) of that storage medium. In other words, the 
5 camera server 110 may use a versatile information 

processing apparatus (e.g., a personal computer or the 
like) which has an interface for connecting the camera 
111. 

The operations of this embodiment with the 
10 aforementioned arrangement will be described in detail 
in turn below. 

When the time set by the operator upon executing 
the operation setup program 113 has been reached, the 
camera server 110 controls the camera 111 to sense a 
15 video at a predetermined position, and stores the 
sensed video. 

Fig. 3 shows an example of the operation setups 
for setting an image sensing schedule of this camera 
server, and the flow of the operation setup program 
20 will be explained below using the flow chart in Fig. 6. 

Default setup data (not shown) are read from the 
auxiliary storage device 106 (S601) , and a setup page 
window 301 in Fig. 3 is displayed in accordance with 
the read data (S602) . If no setup data is available, 
25 items to be described below have no entries. 



On this window, fields 302, 303, and 304 are 
respectively used to input the image sensing start time, 
image sensing end time, and image sensing interval. 
Pan, tilt, and zoom information of the first 
5 preset position can be respectively input using fields 
306-lp, 306-lt, and 306-lz. Pan, tilt, and zoom 
information of the second preset position can be 
respectively input using fields 306-2p, 306-2t, and 
306-2z. Likewise, in this embodiment, a maximum of 
10 five preset positions can be input using the 

corresponding fields. Of course, the number of preset 
positions can be increased/decreased as needed. 

The setup input process in step S604 repeats 
itself until a setup save button 307 is pressed. If 
15 the setup save button 307 has been pressed, the flow 
advances to step S605 (S603) . 

In the setup input process (step S604), data 
input in various fields are checked to change display 
of input data. In the example of Fig. 3, the image 
20 sensing start time, image sensing end time, image 

sensing interval, and camera angle information of the 
first to fourth preset positions are set. 

Since no data is designated for the fifth preset 
position, image sensing and video recording at four 
25 preset positions are designated at the designated image 



sensing interval from the image sensing start time to 
the image sensing end time. 

In step S605, respective pieces of displayed 
information are written in a setup file in the 
5 auxiliary storage device 106. 

In the example shown in Fig. 3, the setup file 
that designates to sense four images from an image with 
a camera angle of the first preset position (pan value 
= 9.72, tilt value = 0.00, and zoom value = 46.80) to 
10 an image with a camera angle of the fourth preset 

position (pan value = 11.30, tilt value = 5.00, and 
zoom value = 40.00) at each of image sensing timings of 
20-min intervals (a total of six timings) from 10:00 
until 11:40 is saved. 
15 Note that registration is made In the operating 

system to launch the video recording execution program 
114 at each image sensing time. 

When the time designated by the operation setup 
program has been reached, the video recording execution 
20 program 114 is launched to sense and store videos. 

The flow of the video recording execution program 
will be explained below using the flow chart in Fig. 7. 

Data (not shown) of the setup file are read from 
the auxiliary storage device 106 (step S701) , and an 
25 image capture command of a predetermined camera angle 
corresponding to each preset position is sent to the 



camera 111 to control the camera 111 to capture an 
image. The captured image is written in the auxiliary 
storage device in correspondence with each image 
capture timing and preset position (step S702) . 
5 For example, the following image capture command 

is issued to the camera 111 for the first preset 
position shown in Fig. 3: 

GetStillImage?pan=9.72&tilt=0.00&zoom=46.80&. . . 
Then, as shown in Fig. 1, from image sensing time 

10 10:00, images at the first, second, third, and fourth 

preset positions are respectively saved as files "image 
data 120-1-1", "image data 120-2-1", "image data 
120-3-1", and "image data 120-4-1" in the auxiliary 
storage device 106. 

15 Likewise, from the next image sensing time 10:20, 

images at the first preset position, second preset 
position,... are saved as files "image data 120-1-2", 
"image data 120-2-2",.... Upon completion of all image 
sensing schedules by repeating the aforementioned 

20 processes, the video recording execution program ends. 

In the above description, the operation setup 
data is saved in the auxiliary storage device 106. 
Alternatively, data may be kept stored in the memory 
101 without being erased even after the operation setup 

25 program 113 ends. 
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Fig. 4 shows an example of the flow of image edit 
processes . 

The flow of the candidate edit program 115 will 
be explained using the flow chart in Fig. 8. This 
5 process starts when a page candidate editor launches 
the page select program 115. 

This embodiment will explain an example wherein a 
"cafeteria menu page" (for example, an intranet is 
built in a given company, and a menu page of a 
10 cafeteria of that company) is created. 

A candidate list window 410 used to select a page 
to be edited is displayed (step S801) . 

If no image page candidate is available, an image 
page that displays a list of images at a specific time 
15 of the respective image sensing positions is 

automatically generated on the basis of image data 
which have been sensed and stored, and the flow 
advances to step S802 to display this page. 

If one candidate is selected, a change image 
20 select window 411 that shows the image page generated 
by the system as page plan 1 is displayed (step S802) . 

In this case, as shown in page plan data 401 
before edit, page plan 1 uses first candidate images of 
the first to fourth preset positions like image data 
25 120-1-1, 120-2-1,.... 



If an end button has been pressed, the flow 
advances to step S806. If one of the displayed images 
is selected, the flow advances to step S805 (decision 
processes in steps S803 and S804). 
5 In step S805, a substitute image select window 

412 that displays images sensed at respective times at 
the same preset position as the selected image as 
substitute candidate images is displayed. If one of 
the displayed images is selected, the selected image is 

10 substituted by the image at the selected time, and the 
flow returns to step S802 to repeat the process. That 
is, the change image select window 413 is displayed. 

For example, when the user wants to change an 
image 421-2-1 and clicks it, this image is selected, 

15 and the flow advances to step S805. 

The image 421-2-1 corresponds to the image data 
120-2-1, and is the image sensed at the second preset 
position at the first time. Then, images sensed at the 
second preset position at respective image sensing 

20 times are displayed, and an image candidate select 

window is displayed. When an image 421-2-3 is selected 
on that window, a page on which the image data 120-2-1 
is substituted by the image data 120-2-3 is created. 

Upon depression of an end button 422, page plan 

25 data 402 is created as page plan 2, and is 

simultaneously saved in the auxiliary storage device 



106 (step S806) . The candidate list is updated (step 
S807). In the next edit process, a candidate list 
window 414 to which a new candidate is added is 
displayed. The candidate edit program has been 
5 explained. 

Upon completion of all image substitute edit 
processes, the page select program 116 executes a page 
authentication process and an upload process to the WWW 
server 203. 

10 This process is started when an approver launches 

the page select program 116. 

Fig. 5 shows an example of the flow of this page 
authentication. The flow of the page select program 
will be explained below using the flow chart in Fig. 9. 

15 Connection to the WWW server is established,, and 

an authentication window 501 of the approver is 
displayed at that time to execute a password 
authentication process (step S901) . If authentication 
has failed, the process is interrupted. 

20 If authentication has succeeded, a candidate page 

select window 502 is displayed (step S902) . Upon 
selection of a candidate, a page approval process 
window 503 is displayed (step S903) . If a reject 
button 510 has been pressed on this window, the process 

25 ends; if it is determined that an approval button 511 



has been pressed (step S904), the flow advances to step 
S905. 

In step S905, the approved image page is uploaded 
to the WWW server 203, thus ending the process. When a 
5 public network is used in place of an intranet (e.g., 
when the Internet is used) , a line disconnection 
process may be done upon completion of transfer. 

With the aforementioned sequence, the WWW service 
on the WWW server 203 publishes the image page on the 
10 network, and the user can access that page via a WWW 
browser on the client. 

The page select program has been explained. 
Note that a plurality of persons can use this 
system as image page candidate editors. 
15 Based on a page that has been edited by a given 

editor, another editor can easily create another image 
page. Hence, candidate plans are created by volunteers, 
and a manager can finally select and approve one of 
such candidate plans and publish the selected page. 
20 As described above, according to this embodiment, 

an image page can be created by selecting only 
appropriate sensed images in units of positions, and 
the load of the edit work can be greatly reduced. By 
selecting a substitute sensed image for only a position 
25 which is required to be changed on the image page 

automatically created by the system, the image page can 
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be modified. Hence, an image of a given position where 
the image is not sensed satisfactorily need only be 
changed, thus further reducing the load of the edit 
work. Furthermore, a plurality of volunteers can 
5 create some image page candidates, and by only 

selecting one of a plurality of created image page 
candidates, the image page can be uploaded to and 
published on the WWW server, thus further reducing 
running cost. 

10 [Second Embodiment] 

In the above embodiment (first embodiment) , 
images are evenly displayed on the candidate page. 
However, the present invention is not limited to such 
specific embodiment. 

15 In the second embodiment, whether each image to 

be displayed is approved is indicated upon displaying a 
candidate page. In this manner, the editor can 
recognize at a glance whether or not each image has 
been edited, thus improving the edit efficiency of an 

20 image page. 

The second embodiment will be described in detail 

below . 

The system arrangement can be achieved by 
replacing the candidate edit program 115 in the camera 
25 server block diagram shown in Fig. 1 by a candidate 
edit program 115' in Fig. 10. 



A substitute recording table 121 is added to the 
contents of the HD 106 in the camera server block 
diagram in Fig. 1 of the first embodiment, as shown in 
Fig. 10. 

5 The operation of the second embodiment will be 

described in detail below. 

The operations of the operation setup program 113, 
video recording execution program 114, and page select 
program 116 are the same as those in the first 

10 embodiment. 

Fig. 11 shows an example of the flow of image 
edit processes. In Fig. 11, reference numeral 412a 
denotes a button used to support (approve) the selected 
image (image 2-3 in Fig. 11) as it is. When an image 

15 is selected, the selected image is displayed so that 

its frame is different from those of other non-selected 
images, thus informing the operator of the selected 
image. In this case, various display patterns may be 
used and, for example, the color, width, or the like of 

2 0 the frame may be changed. When the image that has 

already been supported is selected again, indication on 
the agree button 412a is switched to "support cancel", 
and when the button in this state is selected, support 
can be canceled. 

25 Fig. 13 shows an example of the substitute 

recording table 121. 



Tables are held in correspondence with the first 
to fourth preset positions of respective image data of 
each candidate page, and when an image is substituted 
or is agreed upon, a check mark is recorded in the 
5 corresponding field. 

Since candidate page 1 is automatically generated 
by the page select program 115, and images on this page 
are neither selected nor supported, the fields of all 
the preset positions are blank. 

10 A table for a new candidate page is added by 

copying the same information as that of the source 
candidate page when a given image is substituted or 
supported for the first time. When an image that has 
been supported undergoes operation for canceling that 

15 support, a check mark in the corresponding field is 

removed, and that image undergoes the same operation as 
in an unchecked state. 

The flow of the operation of the candidate edit 
program 115' is substantially the same as that in the 

20 flow chart in Fig. 8 of the first embodiment, except 
that the process in step S805 is changed to a 
substitute image select process in step S805', as shown 
in Fig. 12. 

Steps S801, S803, S804, S806, and S807 in Fig. 12 
25 use the same step numbers as those in Fig. 8 of the 



first embodiment, since they have the same processing 
contents . 

In step S805' after an image is selected in step 
S804, a substitute image select window 412' added with 
5 the image support button 412a is displayed. If the 
button 412a has been pressed, the selected image is 
left unchanged; if another image is selected, the 
selected image is substituted by that image. 

In either case, a check mark is recorded in the 
10 corresponding field of the substitute recording table 
121. The flow returns to step S802 to execute a 
candidate page display process. 

In the candidate page display process in step 
S802, emphasized display (e.g., the selected or 
15 supported image is bounded by a bold frame 1400, as 
shown in Fig. 14) is made on the change image select 
window 411 and substitute image confirm window 413 in 
Fig. 11, a new page plan generation window, or the like. 
In this manner, the editor can clearly recognize the 
20 selected or supported image. Also, the total of the 
list in Fig. 13 may be computed to display the number 
of supports together. 

In step S801, when the source candidate page is 
selected from the candidate list for the first time, 
25 the page may be displayed using the substitute record 
of the source page from the substitute recording table 



121, and when a new candidate page is created by- 
selecting or supporting a given image, the page may be 
displayed using a newly created substitute record of 
the new candidate page. 
5 In this manner, after the source candidate page 

emphasizes images that have been substituted and 
supported on its source page (the source of the source 
candidate page) , a new candidate image can be created. 

Also, images that have been neither selected nor 
10 supported can be consequently emphasized. 

As a result, the editor can recognize images that 
have not been edited, thus improving the edit 
efficiency of an image page. 

As described above, according to the second 
15 embodiment, a satisfactory image page can be easily 

created using edit records of selection and support on 
image pages created by volunteers. 

Especially, since the source candidate page 
emphasizes images that have been substituted and 
20 supported on its source page (the source of the source 
candidate page) , only an image which is not supported 
can be substituted, and a new, satisfactory candidate 
page can be created more easily. 

Since images that have been selected or supported 
25 are emphasized upon editing a candidate page, a new, 
satisfactory candidate page can be created easily. 



Furthermore, since images that have been neither 
selected nor supported are emphasized upon creating a 
candidate page, the editor can recognize images to be 
edited, thus improving the edit efficiency of an image 
5 page, and allowing easy creation of a new, satisfactory 
candidate page. Also, since the editor can know images 
that have not been edited, a new, satisfactory 
candidate page can be easily created. 
[Third Embodiment] 
10 The second embodiment emphasizes images using 

substitute information of each image. However, the 
present invention is not limited to such specific 
embodiment . 

In the third embodiment, if there is an image 
15 which has been neither substituted nor supported upon 
approving a candidate page, the page is approved after 
that image is substituted by a predetermined image 
which is prepared in advance. 

In this manner, an image that has not been edited 
20 is substituted by a preferred image using a 

predetermined image prepared in advance, thus improving 
the appearance of the image page. 

The third embodiment will be described in detail 

below . 

25 The system arrangement is substantially the same 

as that in Fig. 10 of the second embodiment, except 



that the operation setup program 113 and page select 
program 116 in Fig. 10 are replaced by an operation 
setup program 113' and page select program 116', and an 
upload process program 117 is added, as shown in 
5 Fig. 15. 

Also, preferred images 150-1, 150-2,..., 150-4 
are added to the contents of the HD 106 of the second 
embodiment . 

The operation of the third embodiment will be 
10 described in detail below. 

The operation of the video recording execution 
program 114 is the same as that in the second 
embodiment . 

The operation of the candidate edit program 115' 
15 is the same as that in the second embodiment. 

Fig. 16 shows an example of operation setups of 
the operation setup program 113'. 

In the operation setups in Fig. 16, predetermined 
image setup fields 151-1, 151-2,..., 151-4 are added to 
20 the example of the operation setups shown in Fig. 3 of 
the first embodiment. 

In the predetermined image setup fields 151-1, 
151-2,..., 151-4, file names or the like that indicate 
the preferred images 150-1, 150-2,..., 150-4 at the 
25 respective preset positions are input to save the 
preferred images in the HD 106. 
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The flow of the operation of the operation setup 
program 113' is substantially the same as that of the 
operation setup program 113 in Fig. 6 of the first 
embodiment, except that a preferred image setup process 
5 is added. For example, when a given predetermined 

image setup field is selected on the operation setup 
window in Fig. 3, the window is switched to a preferred 
image designation window to designate a preferred image 
Also, the operation of the page select program 

10 116' is substantially the same as the example of the 
operation of the page setup program 116 in Fig. 5 of 
the first embodiment, except that a preferred image is 
added. In the flow of the operation of the page select 
program 116', the contents of the page upload process 

15 in step S905 in Fig. 9 of the first embodiment are 
modified . 

The flow of the operation of the upload process 

program 117 in the third embodiment will be described 

below using the flow chart in Fig. 17. 
20 As in step S904 in Fig. 9 of the first embodiment 

upon depression of the approval button, the upload 

process program 117 is launched. 

In step S1701, the substitute record of the 

approved candidate page is read from the substitute 
25 recording table 121 to search for a preset position 

which is neither selected nor supported. 
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In step S1702, an image of the found preset 
position is substituted by an image of the approved 
candidate page selected from the preferred images 150-1, 
150-2,..., 150-4. 
5 In this manner, an image which is neither changed 

nor supported is substituted by a preset image, and the 
page is uploaded. 

In this case, the preset position, the image of 
which is neither selected nor supported, may be deleted 
10 from the candidate page. 

For example, when an image of preset position 4 
on the candidate page has been neither selected nor 
supported, a candidate page formed by only preset 
positions 1 to 3 is created and approved. 
15 Fig. 18 shows an example of the image page 

approved in this case. 

In this manner, an image that has not been edited 
can be automatically substituted by a preferred image, 
thus improving the appearance of an image page. 
20 Alternatively, by deleting an image which has not 

been edited, only preferred images can be published, 
and the appearance of the image page can be improved. 

As described above, according to the third 
embodiment, when a given candidate page is approved and 
25 is open to the public, an image that has not been 
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edited can be automatically substituted by a preferred 
image, thus improving the appearance of the image page. 

Alternatively, upon approving and publishing a 
given candidate page, the appearance of the image page 
5 can be improved by deleting an image which has not been 
edited. 

In the above embodiments, the operation setup 
program, video recording execution program, candidate 
edit program, page select program, and the like are 

10 executed on the camera server 100. Alternatively, if 

the camera server 100 interprets the commands and sends 
back a sensed image to an information processing device 
to which the commands have been sent, that information 
processing device may execute these programs. 

15 For example, the WWW server 203 may implement 

operation setup, video recording execution, candidate 
edit, and page select processes. In this case, if the 
operation setup program 113, video recording execution 
program 114, candidate edit program 115, and page 

20 select program 116 are described as CGI (Common Gateway 
Interface) programs, the user can execute these 
programs via WWW services on the WWW server 203. 

With this arrangement, the image page editor or 
approver need not visit the camera server 100, and can 

25 edit sensed data at a remote place via the network. 



Alternatively, the video recording execution 
program may be executed on the camera server, and the 
operation setup program, candidate edit program, page 
select program, and the like may be executed on the WWW 
5 server 203. 

In this case, data set by the operation setup 
program can be transferred to the camera server 100, 
which executes video recording on the basis of the 
transferred data. When the candidate edit program 115 
10 or page select program 116 requires image data, the . 
image data can be transferred from the camera server 
100 to undergo the corresponding process. 

In this manner, since image sensing and video 
recording are locally done, image capture failures can 
15 be prevented. On the other hand, images may be 

captured from a plurality of camera servers on the 
network. As a result, for example, images of display 
racks at a plurality of positions can be combined to 
create a menu. 

20 Note that this embodiment is applied to creation 

of a page of displayed items such as a cafeteria menu. 
Also, this embodiment can be applied to creation of a 
page of a pet list of a pet shop in which cages 
containing animals are stacked, and a creation of a 

25 list page of potted plants on a broad floor like a 

gardening shop. Also, this embodiment can be applied 



to creation of an image page that collects best shots 
at respective camera angles by sensing images of street 
corners, resort facilities, and the like. Also, this 
embodiment can be applied to creation of camera 
5 site-dependent best shot collections if images sensed 
by a plurality of cameras are used irrespective of 
their camera angles. That is, the present invention is 
not limited to any specific objects to be sensed. 

In place of selecting images automatically sensed 

10 and stored by the camera at respective positions of an 
image page, the image page may be divided into a 
plurality of sections, candidate images of the 
respective sections may be prepared in advance, and a 
plurality of editors may change images of arbitrary 

15 sections as partial images, thus creating an image page 
in collaboration. 

For example, by preparing, as candidate images, 
product images having variations of chromat icity , 
lightness, and saturation values, cuts that express 

20 different seasons, illustrations that suggest various 
scenes of sports, hobbies, and the like, and so forth, 
a product catalog page, facility guide page, and the 
like can be created in collaboration. 

Furthermore, the image itself may be segmented 

25 into a plurality of areas, and respective partial 

images may be substituted or modified. When a facility 



guide or event guide is expressed by an image like a 
route sketch, or when products, exhibits, or the like 
are introduced together with various illustrations, 
cuts, and the like in a single picture, a guide board, 
5 guide map, and the like can be easily created in 
collaboration by substituting or modifying partial 
images . 

To restate, according to the first embodiment, an 
image page can be created by selecting only appropriate 
10 sensed images in units of positions, and the load of 
the edit work can be greatly reduced. 

By selecting a substitute sensed image for only a 
position which is required to be changed on the image 
page automatically created by the system, the image 
15 page can be modified. Hence, an image of a given 

position where the image is not sensed satisfactorily 
need only be changed, thus further reducing the load of 
the edit work. 

Furthermore, a plurality of volunteers can create 
20 some image page candidates, and by only selecting one 
of a plurality of created image page candidates, the 
image page can be uploaded to and published on the WWW 
server, thus further reducing running cost. 

In the second embodiment, since the source 
25 candidate page emphasizes images that have been 

substituted and supported on its source page (the 
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source of the source candidate page) , a new, 
satisfactory candidate page can be created more easily. 

Also, in the second embodiment, since images that 
have been selected or supported are emphasized upon 
5 editing a candidate page, a new, satisfactory candidate 
page can be created easily. Furthermore, since images 
that have been neither selected nor supported are 
emphasized upon creating a candidate page, the editor 
can recognize images to be edited, thus improving the 

10 edit efficiency of an image page, and allowing easy 

creation of a new, satisfactory candidate page. Also, 
since the editor can know images that have not been 
edited, a new, satisfactory candidate page can be 
easily created. 

15 According to the third embodiment, when. a given 

candidate page is approved and is open to the public, 
an image that has not been edited can be automatically 
substituted by a preferred image, thus improving the 
appearance of an image page. Alternatively, upon 

20 approving and publishing a given candidate page, the 

appearance of an image page can be improved by deleting 
an image which has not been edited. 

As described above, according to the first to 
third embodiments, an image to be included in a 

25 document which is submitted on the network can be 
easily updated. 



[Fourth Embodiment] 

The fourth embodiment of the present invention 
will be described below. 

The arrangement of a camera server that allows 
5 the operation of the fourth embodiment is substantially 
the same as that shown in Fig. 1. Hence, portions 
unique to the camera server that constructs the fourth 
embodiment will be explained below. 

On the memory 101, as shown in Fig. 19, an 
10 operation setup program 10113, video recording 

execution program 10114, and candidate edit program 
10115 as characteristic features of the fourth 
embodiment are stored. 

Also, the auxiliary storage device 106 saves data 
15 as a characteristic feature of the fourth embodiment 
(see Fig. 20 to be described later) . 

The basic operation of the fourth embodiment with 
the above arrangement is the same as that of the first 
embodiment, and an operation unique to the fourth 
20 embodiment will be explained below. 

The camera server 100 senses and stores videos at 
predetermined locations at times set in advance by the 
operator upon executing the operation setup program 
10113. 

25 The flow of the operation setup program is 

substantially the same as that in the first embodiment, 
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and Fig. 3 and the flow chart in Fig. 6 will be 
explained below while substituting portions unique to 
the fourth embodiment. 

In Fig. 6, the operations from step S601 to step 
5 S604 are the same as those in the first embodiment, but 
the operation in step S605 in the fourth embodiment is 
as follows. 

Pieces of information displayed on the setup page 
window 301 are written in setup data (not shown) on the 

10 auxiliary storage device. Then, displacement camera 

angle information is generated for each preset position 
on the basis of camera angle information of the 
corresponding preset position. 

The displacement camera angle information is 

15 information of a new camera angle consisting of values 
obtained by slightly increasing/decreasing the values 
designated by the operator. For example, when a pan 
value = 9.72 is increased/decreased to have a 
displacement difference = 1 so as to obtain two values 

20 each before and after the original value, information 
having pan values = 7.72, 8.72, 10.72, and 11.72 is 
obtained. Such information is generated for each of 
the pan, tilt, and zoom values. Fig. 21 shows an 
example of a list of displacement camera angle 

25 information generated from the camera angle information 
of the first preset position on the window 301. 



In the example shown in Fig. 21, two out of the 
pan, tilt, and zoom values are fixed to generate 
displacement values, but the present invention is not 
limited to such specific example. Two values each 
5 before and after a given value are generated, but the 
present invention is not limited to such specific 
generation range. Alternatively, the operator may 
input or designate these values. A displacement setup 
window 10201 shown in Fig. 22 is an example for such 
10 process. 

After the displacement camera angle information 
for each preset position is generated, it is written in 
displacement setup data {not shown) on the auxiliary 
storage device. 
15 Also, registration is made in the OS to launch 

the video recording execution program 10114 at each 
image sensing time. 

The operation of the operation setup program 
10113 has been explained. 
20 When the time designated by the operation setup 

program has been reached, the video recording execution 
program 10114 is launched to sense and store videos. 
The operation of the video recording execution program 
will be explained below using the flow chart in Fig. 23. 
25 The setup data stored in the auxiliary storage 

device are read {step S10301) , and displacement setup 



data is then determined. The displacement setup data 
is obtained by reading displacement setup data (not 
shown) from the auxiliary storage device or is computed 
from the setup data by uniquely setting a displacement 
5 difference ( step S10302 ) . 

The setup data is extracted in turn from the 
first one in units of preset positions, and if preset 
position data does not reach an end, the flow advances 
to step S10304; otherwise, the program ends (step 

10 S10303) . 

In step S10304, an image is sensed and stored at 
the camera angle of the extracted preset position. A 
predetermined command is sent to the camera 111 to 
control the camera, thus capturing an image. 

15 The captured image is stored by writing data in 

the auxiliary storage device 106. If an image is 
captured at the first image sensing time of the second 
preset position, that image is saved as image data 
10000-2-1-0; if an image is captured at the m-th image 

20 sensing time, that image is saved as image data 
10000-2-m-0. 

Subsequently, data of the corresponding preset 
position is extracted from the displacement setup data, 
and is processed in turn from the first one. If 
25 displacement setup data to be processed still remain, 



the flow advances to step S10306; otherwise, the flow 
returns to step S10303. 

In step S10306, an image is sensed and stored at 
the displacement camera angle of the extracted preset 
5 position. A predetermined command is sent to the 

camera 111 to control the camera, thus capturing an 
image . 

The captured image is stored by writing data in 
the auxiliary storage device 106. If an image is 

10 captured at the first image sensing time of the third 
preset position and at the first displacement angle, 
that image is saved as image data 10000-3-1-1; if an 
image is captured at the (k3)-th displacement angle, 
that image is saved as image data 10000-3-l-k3 . On the 

15 other hand, when images are sensed at these angles and 
at the m-th image sensing time, they are saved as image 
data 10000-3-m-l and 10000-3-m-3k. The video recording 
execution program 10114 has been explained. 

The operation of the candidate edit program 10115 

20 in the fourth embodiment will be described below. 

The flow of the candidate edit program is 
substantially the same as that in the first embodiment, 
and Fig. 4 and the flow chart in Fig. 8 will be 
explained below while substituting portions unique to 

25 the fourth embodiment. Figs. 24 and 25 respectively 
correspond to Figs. 4 and 8. 



This process starts when a page candidate editor 
launches the page select program 10115. 

If no image list page candidate is available, an 
image list page that displays a list of images at a 
5 specific time of the respective preset positions is 
generated on the basis of image data which have been 
sensed and stored. A candidate list page window 410 as 
a list of image list pages, which is used to select the 
newly generated image list page or to select an object 

10 to be edited from existing image list pages, is 
generated and displayed (step S19801) . 

If one candidate to be edited is selected, a 
change image select window 411 that shows the selected 
image list page as page plan 1 is displayed (step 

15 S19802) . In this case, the image list page 401 

generated by the system is used as page plan 1, and 
images 10000-1-1-0, 10000-2-1-0, 10000-3-1-0, and 
10000-4-1-0 sensed at the first timing of the 
respective preset position are used. 

20 If an end button has been pressed, the flow 

advances to step S19806. If one of the displayed 
images is selected, the flow advances to step S19805. 

In step S19805, a substitute image select window 
10401 (Fig. 26) which displays images at displacement 

25 angle positions of the preset position of the selected 
image, and images obtained at other image sensing times 



of the corresponding preset position and displacement 
angle positions as substitute candidates is displayed. 

The select window 10401 displays images of all 
image sensing times and displacement angle positions 
5 associated with that preset position. When the page 
candidate editor selects an optimal image from those 
images, the change image select window 413 is displayed 
again (S19802) . In this case, the image selected in 
step S19804 is substituted by the image selected in 
10 step S19805. 

Upon depression of the end button after the 
aforementioned substitute process is repeated an 
arbitrary number of times, the flow advances to step 
S19806 to generate a new image list page based on the 
15 substituted images. In this case, page plan 2 as the 
second page plan is generated, and its page plan data 
402 is saved in the auxiliary storage device 106. 
Furthermore, the new page plan is added to the 
candidate list in step S19807. 
20 The operation of the candidate edit program 10115 

has been explained. The subsequent operation is the 
same as that of the page select program 116 of the 
first embodiment. 

According to the fourth embodiment, since images 
25 can be sensed not only at camera angles which are set 
in advance but also at nearby angles and be stored 



automatically or by some additional setups, even when 
the object position is not completely fixed, an optimal 
image can be selected or substituted. 

As described above, even when the display 
5 position or the dish size varies, if some setups for 
image sensing within their change ranges are prepared, 
images that allow these changes can be sensed, and an 
image page which has an image of the target object 
falling within the field of view can be easily created. 

10 [Fifth Embodiment] 

In the fifth embodiment, the candidate edit 
program 10115 in the fourth embodiment is replaced by a 
program unique to this embodiment. Since other 
arrangements are the same as those in the fourth 

15 embodiment, a detailed description thereof will be 
omitted . 

The operation of the candidate edit program will 
be explained below using Figs. 27 and 28. The 
candidate edit program (not shown) as a characteristic 
20 feature of the fifth embodiment is stored on the memory 
101 like the program 10115 in the fourth embodiment, 
and is launched by the page candidate editor. 

A candidate page select window 10501 is displayed 
(step S10601) . The candidate page select window has an 
25 area 10511 for inputting a candidate time, and an area 
10512 for selecting a candidate from an existing 



candidate list. When the candidate edit program is 
launched for the first time in a series of processes, 
no existing candidate list is displayed since it is not 
available yet. 

5 If a candidate page to be edited is input as a 

candidate time, the flow advances to step S10603; if a 
candidate page is selected from the existing list, the 
flow advances to step S10604 (S10602) . 

In step S10603, image data stored in the 

10 auxiliary storage device 106 are searched for preset 

angle images sensed at the designated time to generate 
a candidate page to be edited. 

In step S10604, a candidate page 10502 which is 
generated in the previous step or is selected is 

15 displayed. If an end button has been pressed, the flow 
advances to step S10609; if one of the displayed images 
is selected, the flow advances to step S10607 (steps 
S10605 and S10606) . 

In step S10607, a displacement angle substitute 

20 image select window 10503 that displays images at 

displacement angle positions of the image sensing time 
of the selected image as substitute candidates is 
displayed. The page candidate editor compares images 
at the preset positions with those at displacement 

25 angle positions, and selects an optimal image. When 
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the editor has pressed an end button 10531, the 
displacement angle substitute process ends. 

Subsequently, a different time substitute image 
select window 10504 that displays images at other image 

5 sensing times at the displacement angle position 

selected in the immediately preceding step S10607 as 
substitute candidates is displayed in step S10608. The 
page candidate editor compares the image at the image 
sensing time selected in step S10602 with images at 

10 other image sensing times, and selects an optimal image. 
When the editor has pressed an end button 10431, the 
different time substitute process ends, and the change 
image select window 10502 is displayed again (S10604) . 
In this case, the image selected in step S10607 is 

15 substituted by the image selected in step S10608. 

Upon depression of the end button after the 
aforementioned substitute processes are repeated an 
arbitrary number of times, the flow advances to step 
S10609 to generate a new image list page based on the 

20 substituted images and store it in the auxiliary 

storage device 106. Furthermore, the new page plan is 
added to the candidate list in step S10610, thus ending 
the operation of the program. 

The aforementioned operations of the candidate 

25 edit program 18115 from the page editor's view can be 
summarized as follows. 



When the candidate edit program is launched, the 
page editor selects a candidate edit page. When an 
existing candidate page created by another page editor 
or by himself or herself previously is to be edited, 
5 the editor selects the page from the existing candidate 
page list. In order to create a new candidate page, 
the editor sets an image sensing time on the basis of 
knowledge about an object to be sensed (in the example 
of a cafeteria menu, a cafeteria opening time or the 
10 like) , a time at which a candidate page is 

satisfactorily obtained and which is obtained from 
candidate edit experiences so far, and the like, thus 
creating and displaying the candidate page. 

The editor determines an image to be substituted 
15 from those of the respective preset angle positions on 
the candidate page, and selects that image (angle) . 
Then, since a list of displacement images which have 
pan, tilt, and zoom angles slightly different from 
those of the selected image is displayed, the editor 
20 selects an image of an optimal, and substitutes the 

selected image by the selected displacement angle image. 

Furthermore, a list of images at other image 
sensing . times of that displacement angle is displayed. 
The editor similarly selects an image at an optimal 
25 time, and substitutes the selected image with the image 
of the selected image sensing time. In this manner, 



the image substitute process for one preset angle is 
complete . 

If other present angle images are required to be 
substituted, the editor repeats the aforementioned 
5 process. Upon completion of all substitutions, the 
editor presses the end button on the change image 
select window, thus ending the candidate page edit 
process . 

According to the fifth embodiment, upon 

10 substituting each preset position image, a different 
image sensing time image can be selected after a 
displacement angle position image is selected, and when 
many displacement angle position images and different 
image sensing time images are available, a substitute 

15 image can be easily selected. 

In the description of the fifth embodiment, after 
the displacement angle substitute process is done, the 
different time substitute process is done. 
Alternatively, this processing order may be replaced, 

20 i.e., a displacement angle image may be selected after 
a different time image is selected. 

For example, in the example of the cafeteria menu, 
it is nonsense to determine the displacement angle 
using an image before a sample is set. In such case, 

25 it is better to select an optimal image after a sample 
is set from a list of different time images, and to 



determine the displacement angle in correspondence with 

the position where the sample is set. 

Even when an object to be sensed is an animal as 

in an example of a pet shop or the like, and is moving, 
5 an image is selected first using the time, and is 

preferably finely adjusted using displacement angles. 
By contrast, in case of a preset angle with a 

large zoom ratio, the object may often fall outside the 

image sensing range when the pan or title value 
10 deviates even slightly. In such case, it is preferable 

that the displacement angle substitute process be done 

first like in the description of this embodiment. 

[Sixth Embodiment] 

In the sixth embodiment, the video recording 
15 execution program and candidate edit program in the 

fifth embodiment are replaced by ones unique to the 

sixth embodiment. Since other arrangements are the 

same as those in the fifth embodiment, a detailed 

description thereof will be omitted. 
20 The operations of the video recording execution 

program and candidate edit program as characteristic 

features of the sixth embodiment will be described 

below with reference to Fig. 29. 

The video recording execution program resides on 
25 the memory 101, and is called by the OS at the time 

designated by the operation setup program. The basic 



- 50 - 



operation is the same as that of the video recording 
execution program in Fig. 23, but step S17303 as an 
overall image capture/save process unique to this 
embodiment is inserted between steps S10302 and S10303. 
5 In step S17303, a camera angle at which the 

respective preset positions can be sensed 
simultaneously is computed from the setup data read in 
step S10301, and a predetermined command for capturing 
an image at that angle is sent to the camera 111 to 

10 control the camera, thus capturing an image. The 

captured image is stored by writing its data in the 
auxiliary storage device 106. Note that the respective 
positions cannot be simultaneously sensed depending on 
preset positions and the angle performance of the 

15 camera. In such case, partial images may be sensed in 
a plurality of image sensing processes, and may be 
composited to obtain the overall image to be stored. 
Since the subsequent processes are the same as in 
Fig. 23, a description thereof will be omitted. 

20 The operation of the candidate edit program as a 

characteristic feature of the sixth embodiment will be 
explained below with reference to Figs. 30 and 31. 

The candidate edit program resides on the memory 
101, and is launched by the page candidate editor. The 

25 basic operation is the same as that in Fig. 28 

mentioned above, but steps S10601, S10602, and S10603 



in Fig. 28 are respectively replaced by candidate page 
select window display process step S16601, candidate 
page display select/input process step S16602, and 
candidate page creation step S16603 unique to the sixth 
5 embodiment . 

A candidate page select window 107 01 is displayed 
(step S16601) . The candidate page select window 10701 
has an area 10711 for displaying/selecting the overall 
image, and an area 10712 for selecting a candidate from 

10 an existing candidate list. When the candidate edit 
program is launched for the first time in a series of 
processes, no existing candidate list is displayed 
since it is not available yet. The overall image area 
10711 time-serially displays the overall images sensed 

15 and stored in step S17303 by the video recording 
execution program. 

If a candidate page to be edited is selected as 
the overall image, the flow advances to step S16603; if 
it is selected from the existing list, the flow 

20 advances to step S10604 (S16602). 

In step S16603, image data stored in the 
auxiliary storage device 106 are searched for preset 
angle images sensed at the image sensing time of the 
designated overall image, thus creating a candidate 

25 page to be edited. 
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The subsequent operations are the same as those 
of the candidate edit program of the fifth embodiment. 

The operations of the candidate edit program of 
the sixth embodiment from the page editor's view can be 
5 summarized as follows. 

When the candidate edit program is launched, the 
page editor selects a candidate edit page. When an 
existing candidate page created by another page editor 
or by himself or herself previously is to be edited, 
10 the editor selects the page from the existing candidate 
page list. In order to create a new candidate page, 
the editor selects an image which has satisfactorily 
captured respective preset angles as a whole from the 
overall images which are displayed time-serially, thus 
15 creating and displaying a candidate page. 

In the example of a cafeteria menu, when the 
editor begins to edit by selecting an image in which 
fewer persons stand in front of a display case from the 
overall images obtained by sensing the entire display 
20 case, operations for substituting images by those at 

times without any persons standing in front of the case 
in units of preset angles can be reduced. 

According to this embodiment, a candidate page to 
be edited can be visually selected while observing the 
25 overall image in place of the time, thus allowing quick 
edit. 



[Seventh Embodiment] 

The seventh embodiment will be described below. 
When the position of the object to be sensed varies, 
for example, when the number of menu items, the number 
of dishes, and the like vary day by day in a menu 
display case of a cafeteria although "shelves" of the 
display case are fixed in position, the object to be 
sensed may be set at a position different from the 
image sensing position which has been predicted and set 
in advance . 

In such case, when some image sensing positions 
are set like in the first embodiment, the set positions 
undergo automatic interpolation, and image sensing and 
video recording are also done at the positions obtained 
by interpolation to solve the aforementioned problem. 

Various interpolation methods are available. For 
example, a portion between the set image sensing 
positions is divided into a designated number of 
positions, and these divided positions can be added to 
the image sensing positions. 

An example of an interface obtained by modifying 
the interface used to set a plurality of preset 
positions upon operation setups in the first embodiment 
will be explained below. Fig. 32 shows the interface 
obtained by adding numerical value input fields (201-01 
to 201-04) between neighboring preset numbers of the 



image position setup area in Fig. 3 of the first 
embodiment. Points obtained by evenly dividing setup 
values of preset positions on two sides of a given 
field by a numerical value (positive integer) input to 
5 that field are registered as image sensing positions. 

In the aforementioned interpolation method, when 
image sensing positions are set at the two ends of a 
given shelf, and the portion between these positions is 
divided into an arbitrary number of positions, images 

10 of one shelf can be evenly sensed. 

Upon editing a candidate page, a list need not 
always be created using all images at the interpolated 
positions. When the change over time in position of 
the object to be sensed is not so large, a plurality of 

15 positions at which images of the object to be sensed 
can be sensed can be selected at appropriate time 
intervals to create a source candidate page. In the 
subsequent edit work, it suffices to substitute images 
at the respective positions by those sensed at 

20 different image sensing times by fixing the selected 
positions . 

Fig. 33 and the flow chart in Fig. 34 show this 

state . 

In step S203-1 of the flow chart, all images at 
25 all image sensing positions (including the set 
positions and interpolated positions) at a 



predetermined time determined (details of the 
determination process will be omitted) based on an 
image sensing time list or input are displayed. A 
window 202-1 in Fig. 33 is an example when images (15 
5 images) at all the image sensing positions at 11:35 are 
displayed. From these images, a plurality of images 
including the object to be sensed are selected using 
the pointing device 108 (step S203-04). The selected 
images are highlighted, and are registered in a 
10 selection list (step S203-05) . Note that 

selection/non-selection is toggled every time the 
pointing device is operated. 

Upon completion of selection of all images at 
image sensing positions including the desired object to 
15 be sensed, the operator selects a "create" button on 

the window 202-1 in Fig. 33 (step S203-02) to create an 
initial candidate page (step S203-06) , thus ending the 
process . 

When the operator wants to interrupt the process, 
20 he or she can select a "cancel" button (step S203-03) 
to discard the selection list as work data (step 
S203-07), thus ending the process. 

In the example shown in Fig. 33, six image 
sensing positions are selected from 15 positions, and 
25 an initial candidate page 202-02 is generated. 



- 56 - 



In this embodiment, when a large number of image 
sensing positions are obtained by interpolation, images 
displayed for the purpose of selection cannot fall 
within one window. In such case, the select window 
5 202-1 is divided into a plurality of windows, and a 
button or pull-down menu for selecting one of these 
windows can be added. 

When the image sensing positions are separately 
set on a plurality of shelves, this embodiment can be 

10 implemented as follows. That is, "0" is input to one 
of the numerical value input fields 201-01 to 201-04 
each indicating the number of divisions in Fig. 32 to 
indicate the boundary of the shelves. 

For example, when "0" is input to the field 

15 201-03 and values other than zero are input to other 
fields, preset positions 1, 2, and 3 are handled as 
those on the first shelf, and preset positions 4 and 5 
are handled as those on the second shelf. In the flow 
of the processes in this case, steps S203-01 to S203-05 

20 in the flow chart in Fig. 34 are repeated for each 
shelf, and upon completion of selection on all the 
shelves, an initial candidate page is created in step 
S203-06. 

When selection is allowed in units of shelves in 
25 this manner, even when the number of menu items is 

large, each single selection range can be narrowed down, 



thus allowing easy operation and reducing selection 
errors . 

[Eighth Embodiment] 

In the seventh embodiment, the method of creating 
5 an initial candidate page using images at the 

interpolated image sensing positions has been explained. 
Upon editing a page candidate of the first embodiment, 
or after an initial candidate page is created in the 
seventh embodiment, the configuration (the number and 

10 order of images) of that page is often required to be 

changed. An embodiment that allows such change will be 
described using Fig. 35 and the flow chart in Fig. 36. 

Fig. 35 shows a modification of Fig. 4 (the flow 
of image edit processes) in the first embodiment, and 

15 common numbers are used for the same functional 
portions for the sake of simplicity. 

Fig. 36 shows a modification of the main flow of 
the candidate edit program in Fig. 8, and uses common 
numbers for portions having the same functions. 

20 In Fig. 36, a candidate page selected from the 

candidate list is displayed on a window 250-01 in 
Fig. 35. In the first embodiment (Fig. 4), only change 
(substitute) operation of a target image is taken into 
consideration. However, delete, insert, and add 

25 buttons are added on the window 250-01 shown in Fig. 35 
in addition to the change button. The process for 
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changing the configuration of the candidate page using 
these buttons will be explained below using the flow 
chart in Fig. 36. 

In step S251-01, which is different from Fig. 8, 
5 delete operation is made. If the delete button has 

been pressed while a given image is selected, a delete 
process is executed in step S251-02 to delete the 
selected image from the image link structure. 

If it is determined in step S251-03 that the 

10 change button has been pressed while a given image is 
selected, a substitute image select process (step 
S251-04) is executed. This process is the same as that 
in step S805 in Fig. 8. 

If the insert button (step S251-05) or the add 

15 button (step S251-07) is selected while a given image 
is selected, a window 250-02 for selecting image 
sensing positions (angles) in Fig. 35 is displayed. 
Upon selection of an image of desired angles from the 
displayed angles, that image is inserted at the 

20 designated position (before the image selected on the 
window 250-01 upon depression of the insert button; 
after the image upon depression of the add button) of 
the candidate page. 

Fig. 35 shows the flow in which an image 5-1 is 

25 added after an image 2-1 on the window 250-01. 



We often want to cancel these processes in the 
middle of them, but that process is not particularly 
shown. 

The delete process can be executed even when a 
5 plurality of images are selected, but the change, 

insert, and add processes (steps S251-04, S251-06, and 
S251-08) are canceled without any process when a 
plurality of images are selected. 

As described above, according to the eighth 
10 embodiment, when the page candidate is to be edited in 
the first embodiment or after the initial candidate 
page is created even in the seventh embodiment, its 
configuration (the number and order of images) can be 
changed. 

15 Note that the present invention may be applied to 

either a system including a plurality of devices or an 

apparatus consisting of a single device. 

To recapitulate, according to the fourth to 

eighth embodiments, an image page can be created by 
20 selecting only appropriate sensed images in units of 

positions, thus greatly reducing the load of the edit 

work. 

By selecting a substitute sensed image for only a 
position which is required to be changed on the image 
25 page automatically created by the system, the image 
page can be modified. Hence, an image of a given 
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position where the image is not sensed satisfactorily 
need only be changed, thus further reducing the load of 
the edit work. 

Furthermore, a plurality of volunteers can create 
5 some image page candidates, and by only selecting one 
of a plurality of created image page candidates, the 
image page can be uploaded to and published on the WWW 
server, thus further reducing running cost. 

Also, since images with more appropriate angles 
10 can be selected in units of positions without manually 
acquiring them, the load of the edit work can be 
reduced, and an image page can be created using more 
preferred images. 

Moreover, the image sensing time of an image list 
15 page from which the edit work is to start can be 

selected by knowledge and experiences, and the edit 
work can be simplified. 

Also, the edit work can be done while 
independently considering the time and angle, and when 
20 a large number of images are stored, images at 

appropriate times and angles can be selected more 
easily . 

The image sensing time of an image page from 
which- the edit work is to start can be selected using 
25 an image with which respective positions can be grasped 
as a whole, thus simplifying the edit work. 
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As described above, an image to be included in a 
document which is submitted on the network can be 
easily updated, and the image to be sensed can fall 
within the view field the operator intended without 
5 accurately designating the image sensing position. 
[Ninth Embodiment] 

In the first embodiment, an image page is 
published when the approver has approved that page. 
However, the present invention is not limited to this. 
10 In the ninth embodiment, when a given candidate 

page has not been approved after a predetermined time 
has passed, that page is automatically approved. In 
this way, the page can be prevented from being not 
published even after a predetermined time has passed, 
15 thus reducing the running cost. 

The ninth embodiment will be described in detail 

below . 

The system arrangement is substantially the same 
as the camera server diagram shown in Fig. 1, except 
20 that the operation setup program 113 and page select 
program 116 in Fig. 1 are respectively replaced by an 
operation setup program 30113 and page select program 
30116, as shown in Fig. 37. 

The operation of this embodiment will be 
25 described in detail below. 
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Fig. 38 shows an example of operation setups of 
the operation setup program 30113, and the operation 
setups will be explained below using Fig. 38. 

Fig. 38 shows the interface to which a field 
5 30000 is added to that shown in Fig. 3 of the first 

embodiment to allow input of an automatic select time. 

The flow of the operation of the operation setup 
program 30113 is substantially the same as that shown 
in Fig. 6 of the first embodiment, except that the 
10 existing setups and automatic select time are read in 
step S601 1 , and a setup page and automatic select time 
are displayed in step S602', as shown in Fig. 39. 

The operations of the video recording execution 
program 114 and candidate edit program 115 are the same 
15 as those in the first embodiment. 

The flow of the operation of the page select 
program 30116 will be described below with reference to 
the flow chart in Fig. 40. 

The page select program is launched by the 
20 approver or when a predetermined automatic select time 
has been reached. 

The processes in steps S30103 to S30106 in 
Fig. 40 are the same as those in steps S901 to S904 in 
Fig. 9 of the first embodiment. 
25 If it is determined in step S30101 that the 

program has been launched at the automatic select time, 
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image candidate page plan 1 created by the same process 
as in step S801 of the candidate edit program 115 is 
approved in step S30102. 

The approved page is uploaded in step S30107 
5 which is the same as step S905 in Fig. 9 of the first 
embodiment . 

If it is determined in step S30101 that the 
program has been launched not at the automatic select 
time but by the approver, the flow advances to a 

10 password authentication process in step S30103. The 
subsequent processes are the same as those in Fig. 9. 
After the page is uploaded in step S30107 as in step 
S905 in Fig. 9 of the first embodiment, the automatic 
select time setup is cleared. 

15 In place of clearing the automatic select time, 

information indicating that the page has been approved 
may be provided in step S30107, and if the page has 
been approved, it is not uploaded at that time (until 
the predetermined time has been reached) . 

20 In this manner, when the approver does not 

approve the page before a predetermined automatic 
select time is reached, image candidate page plan 1 is 
automatically created and uploaded, thus preventing the 
page from being not published even after the 

25 predetermined time has been reached, and reducing the 
running cost. Note that even the page which has been 
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approved by the approver may not be uploaded before the 
predetermined time is reached. In this case, the 
approver can set an arbitrary upload timing, and it is 
convenient for the approver. 
5 [10th Embodiment] 

In the ninth embodiment, an image candidate page 
is automatically and unconditionally approved when it 
has not been approved before a predetermined time. 
However, the present invention is not limited to such 

10 specific embodiment. 

In the 10th embodiment, when no approval is done 
even after the predetermined time has passed, an 
appropriate page is selected from candidate pages, and 
the selected page is automatically approved. 

15 In this manner, the page can be prevented from 

being not published even after the predetermined time 
has passed, and an appropriate one of candidate pages 
selected by volunteers can be published, thus reducing 
the running cost. 

20 Details of the 10th embodiment will be explained 

below. 

The system arrangement is substantially the same 
as that of the camera server in the ninth embodiment, 
except that the candidate edit program 115 and page 
25 select program 30116 of the ninth embodiment are 

respectively replaced by a candidate edit program 31115 
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and page select program 31116, as shown in Fig. 41. 
Also, a candidate importance list 31000 is added to the 
contents of the HD 106 in the camera server shown in 
Fig. 1 of the first embodiment. 
5 The operation of the 10th embodiment with the 

above arrangement will be described in detail below. 

The operation of the operation setup program 
30113 is the same as that in the ninth embodiment. 
Also, the operation of the video recording execution 
10 program 114 is the same as that in the first or ninth 
embodiment . 

In the flow of the operation of the candidate 
edit program 31115, a candidate importance list update 
process in step S31008 is added to the flow chart in 
15 Fig. 8 of the first embodiment, as shown in Fig. 42. 

Steps S31001 to S31007 in Fig. 42 are the same as steps 
S801 to S807 in Fig. 8, respectively. 

In the operation, after the candidate list is 
updated in step S31007, a candidate importance list is 
20 updated in step S31008, thus ending the candidate edit 
program 31115. 

Fig. 43 shows an example of the candidate 
importance list 31000 in step S31008 . 

This list saves the edit history indicating the 
25 source candidate page of a given candidate page that 
has been edited. 



The importance list 31000 holds: 
"candidate page plan 1:" for automatically 

generated candidate page plan 1; 

"candidate page plan 2: candidate page plan 1 — >" 
5 for candidate page plan 2 modified based on candidate 

page plan 1; 

"candidate page plan 3: candidate page plan 1 — » 
candidate page plan 2" for candidate page plan 3 
modified based on candidate page plan 2; 
10 "candidate page plan 4: candidate page plan 1 — » 

candidate page plan 2 -> candidate page plan 3" for 
candidate page plan 4 modified based on candidate page 
plan 3; and 

"candidate page plan 5: candidate page plan 1 — » 
15 candidate page plan 2" for another candidate page plan 
• 5 modified based on candidate page plan 2. 

In the candidate importance list update process 
in step S31008, a process for updating the candidate 
importance list 31000 and saving the edit histories is 
20 done. 

The flow of the operation of the page select 
program 31116 will be explained below using the flow 
chart in Fig. 44. 

The processes in steps S31201 and S31203 to 
25 S31207 are the same as those in steps S30101 and S30103 
to S30107 of Fig. 40 in the ninth embodiment. In the 
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flow chart in Fig. 44, step S30102 in the flow chart in 

Fig. 40 is replaced by step S31202. 

The page select program is launched by the 

approver or when a predetermined automatic select time 
5 has been reached. 

If it is determined in step S31201 that the 

program has been launched at the automatic select time, 

the flow advances to step S31202 to approve, as a page 

plan with a high importance level, e.g., candidate page 
10 plan 3 having the longest edit history in the candidate 

importance list 31000 created in step S31008 of the 

candidate edit program 31115. 

As in step S30107 in Fig. 40 of the ninth 

embodiment, the page is uploaded in step S31207. 
15 In this manner, when the approver does not 

approve the page before a predetermined automatic 

select time is reached, a page plan that has been best 

edited of candidate page plans edited by volunteers is 

updated, thus preventing the page from being not 
20 published even after the predetermined time has passed, 

and reducing the running cost. 

tilth Embodiment] 

In the 10th embodiment, the importance list holds 

edit histories. However, the present invention is not 
25 limited to such specific embodiment. 



In the 11th embodiment, when a page is not 
approved even after a predetermined time has passed, an 
appropriate one of candidate pages is selected based on 
its record of the number of times of edit and edit time, 
5 and is automatically approved. In this manner, the 
page can be prevented from being not published even 
after the predetermined time has passed, and an 
appropriate one of candidate pages selected by 
volunteers can be published, thus reducing the running 
10 cost. 

Details of the 11th embodiment will be described 

below. 

The system arrangement is substantially the same 
as that of the camera server of the 10th embodiment, 
15 except that the candidate edit program 31115 and page 
select program 31116 in the 10th embodiment are 
respectively replaced by a candidate edit program 32115 
and page select program 32116, as shown in Fig. 45. 
Also, the candidate importance list 31000 in the HD 106 
20 in the camera server of the 10th embodiment is replaced 
by a list 32000. 

The operation of the 11th embodiment with the 
above arrangement will be described in detail below. 
The operation of the operation setup program 
25 30113 is the same as that in the 10th embodiment. Also, 



the operation of the video recording execution program 
114 is the same as that in the first or 10th embodiment. 

The flow of the operation of the candidate edit 
program 32115 is not shown since it is modified to 
5 apply the candidate importance list update process in 
step S31008 in the flow chart of Fig. 42 of the 10th 
embodiment to the 11th embodiment. 

Fig. 4 6 shows an example of the candidate 
importance list 32000 in the 11th embodiment. As shown 
10 in Fig. 4 6, the 11th embodiment saves the number of 
times of edit and the last update time of each 
candidate page. 

The importance list 32000 holds: 

"candidate page plan 1: zero times, 11:20" for 
15 automatically generated candidate page plan 1; 

"candidate page plan 2: once, 11:25" for 
candidate page plan 2 modified based on candidate page 
plan 1; 

"candidate page plan 3: twice, 11:30" for 
20 candidate page plan 3 modified based on candidate page 
plan 2; 

"candidate page plan 4: three times, 11:55" for 
candidate page plan 4 modified based on candidate page 
plan 3; 
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"candidate page plan 5: twice, 11:40" for another 
candidate page plan 5 modified based on candidate page 
plan 2; and 

"candidate page plan 6: three times, 11:45" for 
5 candidate page plan 6 modified based on candidate page 
plan 5 . 

That is, a process for updating the candidate 
importance list 32000 by holding the candidate 
importance level of a new candidate page, the number of 

10 times of modification of which is obtained by 

incrementing that of the source candidate page, and the 
edit time of which is saved is done in the same step as 
step S31008 of Fig. 42. 

The flow of the operation of the page select 

15 program 32116 is not shown since a process for checking 
the importance level in step S31202 in the flow chart 
of Fig. 44 is applied to the 11th embodiment. In this 
step, page plan 3 which has a large number of times of 
edit and the latest update time in the candidate 

20 importance lest 32000 created by the candidate edit 
program 32115 and shown in Fig. 4 6 is approved as a 
page plan with a high importance level. 

That is, since a volunteer who could edit based 
on candidate page 6 present at 11:45 created candidate 

25 page 4 at 11:55, it is determined that page 4 has 
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higher importance level than page 6 although they have 
been modified the same number of times. 

In this manner, when the approver does not 
approve the page before a predetermined automatic 
5 select time is reached, a page plan that has been 

edited by a volunteer who can use the most candidate 
page plans of those edited by volunteers is approved, 
thus preventing the page from being not published even 
after the predetermined time has passed, uploading a 

10 satisfactory image page, and reducing the running cost. 
[12th Embodiment] 

In the 10th and 11th embodiments, the edit record 
is used as an importance. However, the present 
invention is not limited to such specific embodiments. 

15 In the 12th embodiment, a candidate page which 

has been supported without being edited, i.e., without 
requiring any change, is recorded, and when a page has 
not been approved after a predetermined time, an 
appropriate one of candidate pages is selected on the 

20 basis of the record of the number of times of edit, 
edit time, and support without edit, and is 
automatically approved. 

In this manner, the page can be prevented from 
being not published even after a predetermined time has 

25 passed, thus reducing the running cost. 



Details of the 12th embodiment will be explained 
below. The system arrangement is substantially the 
same as that of the camera server of the 11th 
embodiment, except that the candidate edit program 
5 32115 and page select program 32116 in the 11th 

embodiment are respectively replaced by a candidate 
edit program 33115 and page select program 33116, as 
shown in Fig. 47. Also, the candidate importance list 
32000 in the HD 106 of the camera server of the 11th 
10 embodiment is replaced by a candidate importance list 
33000. 

The operation of the 12th embodiment will be 
described in detail below. 

Note that the operation of the operation setup 
15 program 30113 is the same as that in the 11th 

embodiment. Also, the operation of the video recording 
execution program 114 is the same as that in the first 
and 11th embodiment. 

Fig. 4 8 shows an example of the flow of image 
20 edit processes in the 12th embodiment. Reference 

numeral 33001 denotes a button which is used to support 
a candidate page, and can be indicated by a pointing 
device . 

The flow of the operation of the candidate edit 
25 program 33115 is substantially the same as that in 

Fig. 42 of the 10th embodiment, except that step S33109 



of supporting a page is added, and a candidate 
importance list update process in step S33108 
equivalent to step S31008 is modified, as shown in 
Fig. 48. Also, steps S33101 to S33017 are respectively 
5 the same as steps S30101 to S30107 in Fig. 40. 

When a candidate page is displayed in step S33102, 
if the operator has pressed the support button 33001 in 
Fig. 48 in step S33109, the number of times of support 
in the candidate importance list 33000 is incremented 
10 by 1 in step S33108 to update the list 33000, thus 
ending the process. 

If the support button is not pressed, the flow 
advances to step S33103, which is equivalent to step 
S31003. 

15 Fig. 50 shows an example of the candidate 

importance list 33000 updated in step S33108. 

This list saves the number of times of edit, the 
last update time, and the number of times of support of 
each candidate page. 
20 The important list 33000 holds: 

"candidate page plan 1: zero times, 11:20, once" 
for automatically generated candidate page plan 1; 

"candidate page plan 2: once, 11:25, three times" 
for candidate page plan 2 modified based on candidate 
25 page plan 1; 



"candidate page plan 3: twice, 11:30, once" for 
candidate page plan 3 modified based on candidate page 
plan 2; 

"candidate page plan 4: three times, 11:55, zero 
5 times" for candidate page plan 4 modified based on 
candidate page plan 3; 

"candidate page plan 5: twice, 11:40, zero times" 
for another candidate page plan 5 modified based on 
candidate page plan 2; and 
10 "candidate page plan 6: three times, 11:45, once" 

for candidate page plan 6 modified based on candidate 
page plan 5. 

That is, a process for updating the candidate 
importance list 33000 by holding the candidate 
15 importance level of a new candidate page, the number of 
times of modification or the number of times of support 
of which is obtained by incrementing that of the source 
candidate page, and the edit time of which is saved is 
done in step S33108 which is equivalent to step S31008. 
20 In the flow of the operation of the page select 

program 33116, the process for checking the importance 
level in step S31202 in the flow chart of Fig. 44 of 
the 10th embodiment is modified (not shown) . 

Page plan 6 which has the largest sum of the 
25 number of times of edit and the number of times of 

support and has the latest update time in the candidate 



importance list 33000 created by the candidate edit 
program 33115 and shown in Fig. 50 is approved as a 
page plan with a high importance level. 

That is, for example, both candidate page plan 2 
5 having the number of times of edit = 1, and candidate 
page plan 6 having the number of times of edit = 3 have 
a sum of the numbers of times of edit and support = 4, 
and their importance levels are equivalent. In this 
case, it may be determined that candidate page plan 6 

10 which has been updated later has higher importance 
level than page plan 2. 

In this manner, when the approver does not 
approve the page before a predetermined automatic 
select time is reached, a page plan which has been 

15 edited by a volunteer who can use the most candidate 

page plans, and which is supported without edit by many 
volunteers, of those edited by volunteers is approved, 
thus preventing the page from being not published even 
after the predetermined time has passed, uploading a 

20 satisfactory image page, and reducing the running cost. 
[13th Embodiment] 

In the 10th to 12th embodiments, the edit or 
support record of a candidate page is used as the 
importance level. However, the present invention is 

25 not limited to such specific embodiments. 



In the 13th embodiment, a candidate page is 
selected using information as to image selection or 
support without edit, and is automatically approved. 

In this manner, the page can be prevented from 
5 being not published even after a predetermined time has 
passed, and an appropriate one of candidate pages 
selected by volunteers can be published, thus reducing 
the running cost. 

Details of the 13th embodiment will be described 

10 below. 

The system arrangement is substantially the same 
as that of the camera server of the 12th embodiment, 
except that the candidate edit program 33115 and page 
select program 33116 of the 12th embodiment are 

15 respectively replaced by a candidate edit program 34115 
and page select program 34116, the candidate importance 
list 33000 in the HD 106 of the camera server is 
replaced by a candidate importance list 34000, and an 
image importance list 34001 is added to the contents of 

20 the HD, as shown in Fig. 51. 

The operation of the 13th embodiment will be 
described in detail below. 

The operation of the operation setup program 
30113 is the same as that of the 12th embodiment. Also, 

25 the operation of the video recording execution program 



114 is the same as that of the first and 12th 
embodiments . 

Fig. 52 shows an example of image edit processes 
in the 13th embodiment- In Fig. 52, reference numeral 
5 34002 denotes a button which is used to support a 
selected image without edit. 

The flow of the operation of the candidate edit 
program 34115 is substantially the same as that in the 
flow chart of Fig. 49 in the 12th embodiment, except 
10 that the substitute image select /recording process in 
step S34105 and the candidate importance list update 
process in step S34108 in Fig. 49 are modified, as 
shown in Fig. 53. 

Steps S34101 to S34104, S34106, and S34107 are 
15 respectively the same as steps S33101 to S33104, S33106, 
and S33107 in Fig. 49. 

In step S34105 after image selection in step 
S34104, a substitute image select window 34412 with the 
image support button 34002 is displayed. If the button 
20 34002 has been pressed, the contents of the support 

field of the image of interest in the image importance 
list 34001 are counted up. 

If another image is selected, the image of 
interest is substituted by that image, and the contents 
25 of the select field of the image of interest in the 
image importance list 34001 are counted up. 
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More specifically, as in step S33105 in Fig. 49 
of the 12th embodiment, when an image is selected in 
the substitute image select /recording process in step 
S34105, the number of times of image selection in the 
5 image importance list 34001 is incremented by 1 to 
update the image importance list 34001. 

On the other hand, if the support button 34 002 
has been pressed in the substitute image 
select/recording process in step S34105, the number of 
10 times of image support in the image importance list 
34001 is incremented by 1 to update the image 
importance list 34001. The flow then returns to step 
S34102 to execute a candidate page display page. 

Fig. 54 shows an example of the image importance 
15 list 34001 in the 13th embodiment. This list saves the 
number of times of selection or support without edit of 
each image. 

That is, this list holds the numbers of times of 
selection and the numbers of times of support without 
20 edit of all image data 120-1-1, 120-2-1,... generated 
by the video recording execution program 114 in the 
form of a list. 

Fig. 55 shows an example of the candidate 
importance list 34000 in step S34108. This list holds 
25 a score that computes the importance level of each 
candidate page from the image importance list 34001 



created in step S34105 in addition to the contents of 
the candidate importance list 33000 in Fig. 49 of the 
12th embodiment. 

This score can be computed by summing up all the 
5 numbers of times of selection and support of individual 
images, for example, when candidate page plan 1 
includes image data 120-1-1, 120-2-1, 120-3-1, and 
120-4-1. 

As for image data which has been neither selected 
10 nor supported, the importance level of a candidate page 
including that image data is set at zero, since 
volunteers have not edited that page. 

In this case, only the score of the importance 
level computed from the image importance list 34001 may 
15 be set at zero. 

Alternatively, as for image data which has been 
neither selected nor supported, a minus score may be 
given. For example, "1" is subtracted from the 
corresponding score to decrease the importance level of 
2 0 a candidate page that includes the image data of 
interest . 

In this case, the score to be subtracted is not 
limited to "1" but may be a predetermined score. 

In the flow of the operation of the page select 
25 program 34116, the process for checking the importance 



level in step S31202 in the flow chart of Fig. 44 of 
the 10th embodiment need only be modified. 

In the candidate importance list 34000 created by 
the candidate edit program 34115 and shown in Fig. 55, 
5 candidate pages 2 and 6 have a sum of the numbers of 
times of edit and support = 4, and have an equivalent 
importance level. However, the sum of the numbers of 
times of edit and support, and the score of the image 
importance, is 10 for candidate page 2 and 11 for 
10 candidate page 6. Hence, it is concluded that 

candidate page 6 has higher importance level than page 
2. 

If the score remains the same, a page plan which 
has been edited latest is approved as that with high 
15 importance level. 

That is, it is determined that candidate page 
plan 6 which has a largest sum of the number of times 
of edit + the number of times of support + the image 
importance score and has been updated latest has a 
20 highest importance level. 

In another importance computation method, when 
candidate page 6 includes image data which is neither 
selected nor supported, and candidate page 2 does not 
include such image, it is determined that the 
25 volunteers do not consider all images of candidate page 



6 and, hence, candidate page 2 has a higher importance 
level than candidate page 6. 

In this case, as a minus image importance score 
may be given to an image which is not supported, the 
5 importance level of candidate page 6 including an image 
which is not edited is decreased, thus relatively- 
increasing the importance level of candidate page 2 
which has been edited more satisfactorily. 

In this manner, when the approver does not 

10 approve the page before a predetermined automatic 
select time is reached, a page plan which has been 
edited by a volunteer who can use a largest number of 
candidate page plans, and which includes many images 
selected or supported upon creating a candidate page of 

15 those edited by volunteers is approved, thus preventing 
the page from being not published even after the 
predetermined time has passed, uploading a satisfactory 
image page, and reducing the running cost. 
[14th Embodiment] 

20 In the 10th to 13th embodiments, the importance 

level is used in automatic approval of a candidate page. 
However, the present invention is not limited to such 
specific embodiments. 

In the 14th embodiment, the order of candidate 

25 pages in the candidate page list is changed depending 
on their importance level upon displaying the list. 



In this way, upon creating a new image page based 
on a given candidate page, a candidate page to be used 
can be easily determined. 

Details of the 14th embodiment will be explained 

5 below. 

The system arrangement is substantially the same 
as that of the camera server of the 13th embodiment, 
except that the candidate edit program 34115 of the 
13th embodiment is replaced by a candidate edit program 

10 35115, as shown in Fig. 56. 

The operation of the 14th embodiment will be 
described in detail below. Note that the operation of 
the operation setup program 30113 is the same as that 
in the 13th embodiment. Also, the operation of the 

15 video recording execution program 114 is the same as 
that in the first embodiment and ninth to 13th 
embodiments. Furthermore, the operation of the page 
select program 34116 is the same as that in the 13th 
embodiment. Hence, a detailed description of these 

20 programs will be omitted. 

Fig. 57 shows an example of the flow of image 
edit processes of the 14th embodiment. In Fig. 57, 
reference numeral 35000 denotes a window for displaying 
candidates in the order of their importance levels in 

25 the form of a list. 



The flow of the operation of the candidate edit 
program 35115 can be implemented by changing the 
candidate list display process in step S33101 in the 
flow chart of Fig. 4 9 in the 12th embodiment. 
5 The flow of the operation of the candidate list 

display process will be explained below using the flow 
chart in Fig. 58. 

When the candidate list display process starts, 
the candidates in the candidate list are sorted in step 

10 S35101 on the basis of the candidate importance list 
34000 (Fig. 55) created in step S34108 in Fig. 53 of 
the 13th embodiment and the computation results of 
importance levels as in step S31202 in Fig. 44 of the 
10th embodiment. 

15 In step S35102, the candidate list is displayed. 

In this way, the candidate list window 35000 used 
to select a page to be edited by the candidate edit 
program 35115 is displayed in the order of importance 
levels of the candidates, and it becomes easy to edit 

20 based on a more suitable candidate page, thus reducing 
the running cost. 

In the above description, the importance level is 
computed for a partial modification in consideration of 
the number of times of edit and the number of times of 

25 support in the example in which images automatically 
sensed and stored by the camera are substituted. 



Alternatively, a partial image may be selected from 
partial image candidates which are prepared by some 
method, as described above. 

Furthermore, the above embodiment may be applied 
5 to a case wherein an image is segmented into partial 
images, which are to be modified. 

In this case, a larger weight may be assigned to 
support than edit. 

In the ninth to 14th embodiments described above, 
10 the processes in the camera server have been 

exemplified. In this case, the camera server may be 
either a system including a plurality of devices or an 
apparatus consisting of a single device. 

To restate, according to the above embodiments, a 
15 preferred one of image pages created by volunteers is 
published, thus reducing the running cost. 

Especially, in the ninth embodiment, when a page 
has not been approved after a predetermined time has 
passed, the page is automatically approved, thus 
20 publishing a candidate page, and reducing the running 
cost . 

In the 10th embodiment, when the approver does 
not approve any page before the predetermined automatic 
select time has been reached, a page plan which has 
25 been best edited of candidate page plans edited by 



volunteers is uploaded, thus publishing a preferred 
image page, and reducing the running cost. 

In the 11th embodiment, since a page plan which 
has been edited by a volunteer who can use a largest 
5 number of candidate pages is approved, a preferred 

image page can be published, thus reducing the running 
cost . 

In the 12th embodiment, since a page plan which 
has been edited by a volunteer who can use a largest 
10 number of candidate pages and which is supported by 

many volunteers is approved, a preferred image page can 
be published, thus reducing the running cost. 

In the 13th embodiment, since a candidate page 
plan which has been edited by a volunteer who can use a 
15 largest number of candidate pages and which is 

supported by many volunteers and includes many selected 
or supported images is approved, a preferred image page 
can be published, thus reducing the running cost. 

Also, in the 13th embodiment since the importance 
20 level of a candidate page plan which includes an image 
which is not supported upon creating the candidate page 
is decreased, a more preferred image page can be 
published, thus reducing the running cost. 

In the 14th embodiment, since the candidate list 
25 is displayed in the order of importance levels of 

candidates, it becomes easy to edit based on a more 
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preferred candidate page, thus publishing a preferred 
image page, and reducing the running cost. 

When the above embodiment is applied to a case 
wherein a page or image is partially edited in place of 
5 selecting an image in units of angles, the score can be 
computed for the entire page while page or image parts 
are edited or even when an identical part is shared by 
a plurality of persons, a good image or page can be 
created in collaboration. 

10 As described above, according to the ninth to 

14th embodiment, an image to be included in a document 
which is submitted on the network can be easily updated, 
and can be automatically published on the network. 
[15th Embodiment] 

15 In the first embodiment, images are evenly 

displayed on a candidate page. However, the present 
invention is not limited to such specific embodiment. 

The 15th embodiment will be described in detail 

below . 

20 The system arrangement is substantially the same 

as that of the camera server in the first embodiment, 
except that the candidate edit program 115 in the first 
embodiment is replaced by a candidate edit program 
40115, and a publication inhibition setup program 40117 

25 is added to the contents of the memory 101 in Fig. 1 of 
the first embodiment, as shown in Fig. 59. 



The operations of the operation setup program 113, 
video recording execution program 114, and page select 
program 116 are the same as those in the first 
embodiment. Note that video recording data records 
5 information of image sensing positions and times. 

Fig. 60 shows an example of the operation setups 
of the publication inhibition setup program 40117, and 
the flow of the publication inhibition setup program 
will be explained below using the flow chart in Fig. 61. 

10 The publication inhibition program is launched in 

response to an operator's request. Existing setup data 
(not shown) is read from the auxiliary storage device 
(step S41101), and a setup page window 41001 in Fig. 60 
is displayed (step S41102) . On this window, 

15 publication inhibition start and end times common to 
all the positions can be input in fields 41002 and 
41003. In position-dependent setups, the publication 
inhibition start and end times of the first preset 
positions can be input in fields 41004 and 41005. Also, 

20 a publication inhibition position can be set in a field 
41006 irrespective of time. Likewise, publication 
inhibition setups can be made for a maximum of five 
preset positions in the 15th embodiment. Of course, 
the number of positions may be increased. The setup 

25 input process in step S41104 repeats itself until a 
setup save button 41007 is pressed, and if it is 



determined that the setup save button 41007 has been 
pressed (step S41103) , the flow advances to step S41105. 

In the setup input process in step S41104, data 
input to various fields are checked, and display of 
5 input data is changed. In the example of Fig. 60, the 
publication inhibition start and end times common to 
all the positions, and the publication inhibit time 
information of the first preset position are set. Also, 
since the fields for the fourth preset position have no 

10 time entry about time, and designate that the image is 
not to be published, an image at this position is not 
published irrespective of time in this setup. 

In step S41105, pieces of displayed information 
are written in the auxiliary storage device. In the 

15 example in Fig. 60, setups indicating that images are 
not published from 10:00 to 10:10 for all the preset 
positions, and an image at the first preset position 
from 10:50 to 11:00 and all images at the fourth preset 
position are not published are saved. 

20 In this embodiment, the publication inhibition 

setup program 40117 is launched in response to an 
operator's request. In this case, the video recording 
execution program 114 might have already been executed. 
When the publication inhibition positions and times are 

25 known in advance, if the publication inhibition setup 

program is called from the operation setup program upon 



execution of the operation setup program 113, this 
setup is reflected upon execution of the video 
recording execution program, and images at the 
publication inhibition positions or the publication 
5 inhibition times can be prevented from being captured 
and stored. In this manner, the memory can be 
prevented from being wasted, and the running cost can 
be reduced. Also, the image sensing position or image 
sensing time need not be saved together with an image. 
10 The publication inhibition setup program has been 
explained. 

Fig. 62 shows the flow of image edit processes. 
In Fig. 62, a button 42001 is added to the 
interface shown in Fig. 4 of the first embodiment to 

15 allow to cancel image substitution. 

The flow of the operation of the candidate edit 
program 40115 is as shown in Fig. 63, and is 
substantially the same as the flow chart of Fig. 8 of 
the first embodiment, except that a candidate page 

20 display process in step S42102, a substitute image 

select process in step S42105, a setup read process in 
step S42108, and a publication inhibited image check 
process in step S42109 are added to the head of the 
flow in this order. 

25 Steps S42101, S42103, S42104, S42106, and S42107 

in Fig. 63 are respectively the same as steps S801, 
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S803, S804, S806, and S807 in Fig. 8 of the first 
embodiment . 

A process executed when the button 42001 in 
Fig. 62 is clicked in step S42105 upon selecting an 
5 image in step S42104 so as to cancel image selection is 
added to step S805 in Fig. 8 of the first embodiment. 

Fig. 64 shows an example of the contents of a 
publication list 42201 in the 15th embodiment. 

In the setup read process in step S42108, setup 
10 data (stored in the HD 106) generated by the 

publication inhibition setup program 40117 is read to 
execute a publication inhibited image check process 
{step S42109) . That is, it is checked based on the 
position and image sensing time if each image is 
15 inhibited from being published. If an image can be 

published, "OK" is stored in the corresponding field of 
the publication list; if an image is inhibited from 
being published, "NG" is stored. 

In the candidate page display process in step 
20 S42102 and the substitute image select process in step 
S42105, publication inhibited images are displayed to 
be distinguished from other images on the basis of the 
publication inhibited image check process result. In 
the example shown in Fig. 62, publication inhibited 
25 images such as image 421-2-1 on the change image select 
window 411 and images 421-2-1 and 421-2-4 on the 



substitute image select window 412 can be displayed to 
be easily distinguished from other images. 

In the 15th embodiment, when publication 
inhibition conditions are set, publication inhibited 
5 images are emphasized upon displaying a candidate page. 
In this manner, whether or not each image can be 
published can be determined, thus improving the edit 
efficiency of an image list page. 

Also, an image which should not be published 
10 inadvertently can be prevented from being uploaded. 
[16th Embodiment] 

In the 10th to 14th embodiments, importance 
computations are made using edit or support records of 
a candidate page or select or support records of images. 
15 However, the present invention is not limited to such 
specific embodiments. 

In the 16th embodiment, the priority of a 
candidate page is changed using publication inhibited 
image information. 
20 In this way, an image list page that includes a 

publication inhibited image can be prevented from being 
open to the public. 

Details of the 16th embodiment will be explained 

below . 

25 The system arrangement is substantially the same 

as that of the camera server of the 14th embodiment, 
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except that the candidate edit program 35115 and page 
select program 34116 of the 14th embodiment are 
respectively replaced by a candidate edit program 
43115 and page select program 43116, as shown in 
5 Fig. 65. Also, the candidate importance list 34001 in 
the HD 106 of the camera server of the 14th embodiment 
is replaced by an image importance list 44001. 

The operations of the operation setup program 
30113 and video recording execution program 114 are the 
10 same as those in the 14th embodiment. 

The operation of the 16th embodiment will be 
described in detail below. 

The flow of the operation of the candidate edit 
program 43115 is substantially the same as the flow 
15 chart of Fig. 53 in the 13th embodiment, except that 
step S34105 is replaced by a substitute image 
select/recording process (step S44105) , and a setup 
read process (step S44108) and a publication inhibited 
image check process (step S44109) are added to the head 
20 of the flow in this order, as shown in Fig. 66. 

Fig. 67 shows an example of the image importance 
list 44001 in the 16th embodiment. In this list, a 
publication field is added to the image importance list 
34001. 

25 Note that the setup read process (step S44108) is 

the same as that in the 15th embodiment, and the 



publication inhibition process (step S44109) is also 
substantially the same as that in the 15th embodiment. 
In the process of the 15th embodiment, the list to be 
updated is the publication list 42201, but in the 
5 publication inhibited image check process S44109 of the 
16th embodiment, the image importance list 4 4 001 is 
used. In both these processes, the contents of the 
publication field are updated. 

Also, in the substitute image select /recording 

10 process (step S44105) , the contents of the select and 
support fields are similarly updated, although the 
image importance list 44001 is used. 

In the example shown in Fig. 67, an image 120-1-1 
has a number of times of selection = 1 and a number of 

15 times of support = 1, and can be published. Likewise, 

an image 120-3-1 has a number of times of selection = 2 
and a number of times of support = 0, and is inhibited 
from being published. Also, an image 120-1-2 has both 
numbers of times of selection and support = 0, and is 

20 inhibited from being published. In this example, "OK" 
or "NG" is recorded as publication information for the 
sake of simplicity. Alternatively, if "0" for OK or 
"-100" for NG is recorded, the importance level of each 
image can be computed from the image importance list. 

25 That is, the page select program 43116 implements 

substantially the same operations as in the 13th and 
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14th embodiments, except that a score as to whether an 
image is allowed to be published or not is added 
(subtracted) . 

In this fashion, an image page that satisfies the 
5 publication inhibition conditions is harder to select, 
thus improving the select efficiency. 
[17th Embodiment] 

In the 17th embodiment, a page upload process 
(see Fig. 3) in step S31207 in the page select program 

10 34116 has different processing contents. Prior to page 
upload, whether or not an image at each position is 
inhibited from being published is checked with 
reference to the image importance list 44001. If the 
image of interest is inhibited from being published, it 

15 is substituted by a predetermined image. For example, 
the image of interest is substituted by an image of 
text "this image cannot be published" which is prepared 
in advance. After that, the page is uploaded. For 
example, when an image at the second position is 

20 inhibited from being published, a display like on a 
window 45001 in Fig. 68 is made. 

In this manner, an image which is set to be 
inhibited from being published is not published even if 
it is picked up upon edit, thus allowing secure 

25 operation. 



In the above example, an image is substituted by 
another image. Alternatively, a publication inhibited 
image may be simply deleted from the page to be 
uploaded. 

5 Also, not only a publication inhibited image but 

also an image which is neither supported nor edited may 
be handled similarly. 

In the first to 17th embodiments mentioned above, 
the processes in the camera server have been 

10 exemplified. In this case, the camera server may be 

either a system including a plurality of devices or an 
apparatus consisting of a single device. 

The objects of the present invention are also 
achieved by supplying a storage medium (or recording 

15 medium) , which records a program code of a software 
program that can implement the functions of the 
above-mentioned embodiments to the system or apparatus, 
and reading out and executing the program code stored 
in the storage medium by a computer (or a CPU or MPU) 

20 of the system or apparatus. In this case, the program 
code itself read out from the storage medium implements 
the functions of the above-mentioned embodiments, and 
the storage medium which stores the program code 
constitutes the present invention. The functions of 

25 the above-mentioned embodiments may be implemented not 
only by executing the readout program code by the 



computer but also by some or all of actual processing 
operations executed by an OS (operating system) running 
on the computer on the basis of an instruction of the 
program code. 

5 Furthermore, the functions of the above-mentioned 

embodiments may be implemented by some or all of actual 
processing operations executed by a CPU or the like 
arranged in a function extension board or a function 
extension unit, which is inserted in or connected to 

10 the computer, after the program code read out from the 
storage medium is written in a memory of the extension 
board or unit. 

To recapitulate, according to the above 
embodiments, a preferred one of image pages created by 

15 volunteers is open to the public, thus reducing the 
running cost. 

Especially, in the 15th embodiment, upon creating 
a candidate image list page, a publication inhibited 
image can be emphasized upon being displayed, thus 

20 greatly reducing the load of the edit work. 

In the 16th embodiment, since the importance 
level of automatic selection of a candidate page on 
which an image at the inhibited position or time is 
selected is decreased, an image list page including a 

25 publication inhibited image can be prevented from being 
published. 



In the 17th embodiment, when a candidate page is 
approved and is open to the public, a publication 
inhibited image is automatically substituted by a 
preferred image, thus improving the appearance of an 
5 image list page. 

Furthermore, in the 17th embodiment when a 
candidate page is approved and is open to the public, a 
publication inhibited image is deleted, thus improving 
the appearance of an image list page. Also, even when 
10 a publication inhibited image is inadvertently picked 

up upon edit, it can be prevented from being published, 
thus improving security. 

As described above, according to the 15th to 17th 
embodiments, an image to be included in a document 
15 which is submitted on the network can be easily updated, 
and an image which is sensed under a required image 
sensing condition can be set to be inhibited from being 
published. 

As many apparently widely different embodiments 
20 of the present invention can be made without departing 
from the spirit and scope thereof, it is to be 
understood that the invention is not limited to the 
specific embodiments thereof except as defined in the 
appended claims. 



WHAT IS CLAIMED IS: 

1. An information processing apparatus for 
submitting document information including an image via 
a network, comprising: 

5 image input means; 

schedule storage means for storing input schedule 
information of said image input means; 

image storage means for storing an image obtained 
in accordance with the schedule information; and 
10 document creation means for creating new document 

information by substituting an image in the document 
information by the image stored in said image storage 
means . 

2. The apparatus according to claim 1, further 
15 comprising means for transferring the document 

information created by said document creation means to 
a network server. 

3. The apparatus according to claim 1, further 
comprising designation means for designating an image 

2 0 in the old document information to be changed by an 
image newly stored in said image storage means. 

4. The apparatus according to claim 3, further 
comprising display control means for displaying the 
changed image in a different pattern. 

25 5. The apparatus according to claim 3, further 

comprising display control means for, when an image in 



the document information is selected, displaying that 
image in a pattern different from other images. 

6. The apparatus according to claim 1, further 
comprising means for storing an image prepared in 

5 advance, and substituting an image in the document 
information, which is not changed, by the image 
prepared in advance. 

7. The apparatus according to claim 1, wherein the 
document information is HTML document information. 

10 8. The apparatus according to claim 1, wherein the 
input schedule includes an image sensing position and 
time . 

9. A method of controlling an information processing 
apparatus for submitting document information including 

15 an image via a network, comprising: 

the step of storing input schedule information of 
predetermined image input means; 

the step of storing an image obtained in 
accordance with the schedule information; and 
20 the step of creating new document information by 

substituting an image in the document information by 
the image stored in said image storage means. 

10. A storage medium that stores a computer program 
code for an information processing apparatus which 

25 comprises image input means and submits document 

information including an image via a network, storing: 
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a program code of the step of storing input 
schedule information of predetermined image input 
means; 

a program code of the step of storing an image 
5 obtained in accordance with the schedule information; 
and 

a program code of the step of creating new 
document information by substituting an image in the 
document information by the image stored in said image 
10 storage means. 

11. An information processing apparatus for updating 
an image in document information to be submitted via a 
network, comprising: 

video input means capable of remote-controlling 
15 an image sensing positions- 
schedule storage means for storing schedule 
information having an image sensing position and time 
of said video input means; 

control means for activating said video input 
20 means in accordance with the schedule information 

stored in said schedule storage means, and saving an 
obtained image in predetermined image storage means; 
and 

document creation means for creating new document 
25 information by substituting an image at an image 

sensing position in old document information, which 
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corresponds to an image sensing position of an image 
stored in the image storage means, by that image. 

12. The apparatus according to claim 11, further 
comprising means for transferring the document 

5 information created by said document creation means to 
a network server. 

13. The apparatus according to claim 11, further 
comprising designation means for designating an image 
in the old document information to be changed by an 

10 image newly stored in said image storage means. 

14. The apparatus according to claim 13, further 
comprising display control means for displaying the 
changed image in a different pattern. 

15. The apparatus according to claim 13, further 

15 comprising display control means for, when an image in 
the document information is selected, displaying that 
image in a pattern different from other images. 

16. The apparatus according to claim 11, further 
comprising means for storing an image prepared in 

20 advance, and substituting an image in the document 
information, which is not changed, by the image 
prepared in advance. 

17. The apparatus according to claim 11, wherein the 
document information is HTML document information. 

25 18. A method of controlling an information processing 
apparatus which comprises video input means capable of 



- 102 - 



remote-controlling an image sensing position and makes 
the video input means capture an image in document 
information to be submitted via a network, comprising: 
the step of storing schedule information having 
5 an image sensing position and time of the video input 
means; 

the step of activating the video input means in 
accordance with the stored schedule information, and 
saving an obtained image in predetermined image storage 

10 means; and 

the step of creating new document information by 
substituting an image at an image sensing position in 
old document information, which corresponds to an image 
sensing position of an image stored in the image 

15 storage means, by that image. 

19. A storage medium that stores a computer program 
code for an information processing apparatus which 
comprises video input means capable of 

remote-controlling an image sensing position and makes 
20 the video input means capture an image in document 

information to be submitted via a network, storing: 
a program code of the step of storing schedule 

information having an image sensing position and time 

of the video input means; 
25 a program code of the step of activating the 

video input means in accordance with the stored 
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schedule information, and saving an obtained image in 
predetermined image storage means; and 

a program code of the step of creating new 
document information by substituting an image at an 
5 image sensing position in old document information, 
which corresponds to an image sensing position of an 
image stored in the image storage means, by that image. 

20. An information processing apparatus for 
submitting document information including an image via 

10 a network, comprising: 

image input means; 

schedule input means for inputting schedule 
information pertaining to image capture of said image 
input means; 

15 correction means for correcting the schedule 

information input by said schedule input means; 

image storage means for storing an image obtained 

in accordance with new schedule information corrected 

by said correction means; and 
20 document creation means for creating document 

information on the basis of an image stored in said 

image storage means. 

21. The apparatus according to claim 20, further 
comprising means for transferring the document 

25 information created by said document creation means to 
a network server. 
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22. The apparatus according to claim 20, wherein said 
correction means computes new image sensing positions 
by varying one image sensing position in the schedule 
information within a predetermined range around that 

5 image sensing position as a center. 

23. The apparatus according to claim 20, wherein said 
correction means includes means for generating a new 
position that interpolates between two positions of 
said image input means. 

10 24. The apparatus according to claim 20, further 
comprising edit means for deleting, inserting, and 
adding an image in the document information created by 
said document creation means. 

25. The apparatus according to claim 20, further 
15 comprising means for displaying and selecting 

displacement images so as to select an image to be 
included in a document . 

26. The apparatus according to claim 20, further 
comprising means for sensing an image over a broad 

20 range and storing the sensed image in image recording 
means when image sensing is done on the basis of the 
schedule information. 

27. The apparatus according to claim 20, wherein the 
document information is HTML document information. 

25 28. A method of controlling an information processing 
apparatus which has image input means and submits 
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document information including an image via a network, 
comprising : 

the input step of inputting schedule information 
pertaining to image capture of the image input means; 
5 the correction step of correcting the input 

schedule inf ormation; 

the storage step of storing an image obtained in 
accordance with corrected, new schedule information; 
and 

10 the document creation step of creating document 

information on the basis of the stored image. 
29. A storage medium that stores a program code for 
an information processing apparatus which has image 
input means and submits document information including 
15 an image via a network, storing: 

a program code of the input step of inputting 
schedule information pertaining to image capture of the 
image input means; 

a program code of the correction step of 
20 correcting the input schedule information; 

a program code of the storage step of storing an 
image obtained in accordance with corrected, new 
schedule information; and 

a program code of the document creation step of 
25 creating document information on the basis of the 
stored image. 
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30. An information processing apparatus for updating 
an image in document information to be submitted via a 
network, comprising: 

video input means capable of remote-controlling 
5 an image sensing position; 

schedule storage means for storing schedule 
information having an image sensing position and time 
of said video input means; 

computation means for computing a plurality of 
10 new image sensing positions on the basis of an image 

sensing position in the schedule information stored in 
said schedule storage means; 

control means for activating said video input 
means in accordance with the new image sensing position 
15 computed by said computation means and the image 
sensing time, and saving an obtained image in 
predetermined image storage means; and 

document creation means for creating document 
information on the basis of the image stored in the 
20 image storage means. 

31. The apparatus according to claim 30, further 
comprising means for transferring the document 
information created by said document creation means to 
a network server. 

25 32. The apparatus according to claim 30, wherein said 
computation means computes new image sensing positions 



within a predetermined range having one image sensing 
position as a center. 

33. The apparatus according to claim 32, wherein the 
predetermined range is set for each of a pan angle, 

5 tilt angle, and zoom ratio of said video input means. 

34. The apparatus according to claim 30, wherein said 
computation means computes a plurality of displacement 
image sensing positions that interpolate between two 
image sensing positions. 

10 35. The apparatus according to claim 32, further 
comprising means for displaying and selecting 
displacement images so as to select an image to be 
included in a document. 

36. The apparatus according to claim 30, further 
15 comprising means for sensing an image over a broad 

range and storing the sensed image in image recording 
means when image sensing is done on the basis of the 
schedule information. 

37. The apparatus according to claim 30, wherein the 
2 0 document information is HTML document information. 

38. The apparatus according to claim 30, further 
comprising edit means for deleting, inserting, and 
adding an image in the document information created by 
said document creation means. 

25 39. A method of controlling an information processing 
apparatus which comprises video input means capable of 



remote-controlling an image sensing position, and makes 
the video input means capture an image in document 
information to be submitted via a network, comprising: 
the step of storing schedule information having 
5 an image sensing position and time of the video input 
means ; 

the step of computing a plurality of new image 
sensing positions on the basis of an image sensing 
position in the stored schedule information; 
10 the step of activating the video input means in 

accordance with the computed, new image sensing 
position and the image sensing time, and saving an 
obtained image in predetermined image storage means; 
and 

15 the step of creating document information on the 

basis of the image stored in the image storage means. 
40. A storage medium that stores a computer program 
code for an information processing apparatus which 
comprises video input means capable of 

20 remote-controlling an image sensing position, and makes 
the video input means capture an image in document 
information to be submitted via a network, storing: 

a program code of the step of storing schedule 
information having an image sensing position and time 

25 of the video input means; 
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a program code of the step of computing a 
plurality of new image sensing positions on the basis 
of an image sensing position in the stored schedule 
information; 

5 a program code of the step of activating the 

video input means in accordance with the computed, new 
image sensing position and the image sensing time, and 
saving an obtained image in predetermined image storage 
means ; and 

10 a program code of the step of creating document 

information on the basis of the image stored in the 
image storage means. 

41. An information processing apparatus for 
submitting document information including an image via 
15 a network, comprising: 

image input means; 

schedule input means for inputting schedule 
information pertaining to image capture of said image 
input means ; 

20 correction means for correcting the schedule 

information input by said schedule input means; 

image storage means for storing an image obtained 
in accordance with new schedule information corrected 
by said correction means; 
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document creation means for creating document 
information on the basis of an image stored in said 
image storage means; 

authentication means for authenticating if a 
5 candidate document is submitted onto the network; and 
submission control means for controlling 
submission of the candidate document onto the network 1 
in accordance with a predetermined condition 
irrespective of an authentication result of said 
10 authentication means. 

42. The apparatus according to claim 41, wherein said 
submission control means submits a document to a 
document browsing server provided on the network, and 
updates an old document present on the server. 
15 43. The apparatus according to claim 41, wherein said 
submission control means includes selection means for 
selecting a document with high submission priority from 
candidate documents previously created by said document 
creation means. 

20 44. The apparatus according to claim 43, wherein said 
selection means selects a document with high priority 
on the basis of edit histories of individual candidate 
documents . 

45. The apparatus according to claim 44, wherein said 
25 selection means selects a candidate document with the 
longest edit history. 
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46. The apparatus according to claim 44, wherein said 
selection means selects a document with high priority 
on the basis of the number of times of edit and a 
latest update date of a document. 
5 47. The apparatus according to claim 44, wherein said 
selection means selects a document on the basis of the 
number of times of support when a support instruction 
is issued to a candidate document created by said 
document creation means. 
10 48. The apparatus according to claim 44, wherein said 
selection means selects a candidate document with 
reference to the number of times of selection of an 
image assigned to the document. 

49. The apparatus according to claim 41, wherein said 
15 selection means includes means for displaying a list of 

candidate documents. 

50. A method of controlling an information processing 
apparatus which comprises image input means and submits 
document information including an image via a network, 

20 comprising: 

the schedule input step of inputting schedule 
information pertaining to image capture of the image 
input means; 

the correction step of correcting the schedule 
25 information input in the schedule input step; 



- 112 - 



the image storage step of storing an image 
obtained in accordance with new schedule information 
corrected in the correction step; 

the document creation step of creating document 
5 information on the basis of an image stored in the 
image storage step; 

the authentication step of authenticating if a 
candidate document is submitted onto the network; and 

the submission control step of controlling 
10 submission of the candidate document onto the network 
in accordance with a predetermined condition 
irrespective of an authentication result in the 
authentication step. 

51. A storage medium that stores a program code for 
15 an information processing apparatus which comprises 
image input means and submits document information 
including an image via a network, storing: 

a program code of the schedule input step of 
inputting schedule information pertaining to image 
20 capture of the image input means; 

a program code of the correction step of 
correcting the schedule information input in the 
schedule input step; 

a program code of the image storage step of 
25 storing an image obtained in accordance with new 

schedule information corrected in the correction step; 
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a program code of the document creation step of 
creating document information on the basis of an image 
stored in the image storage step; 

a program code of the authentication step of 
5 authenticating if a candidate document is submitted 
onto the network; and 

a program code of the submission control step of 
controlling submission of the candidate document onto 
the network in accordance with a predetermined 
10 condition irrespective of an authentication result in 
the authentication step. 

52. An information processing apparatus for 

submitting document information including an image via 

a network, comprising: 
15 image input means; 

schedule storage means for storing input schedule 

information of said image input means; 

image storage means for storing an image obtained 

in accordance with the schedule information; 
20 document creation means for creating new document 

information by substituting an image in the document 

information by the image stored in said image storage 

means; and 

setting means for setting a condition for 
25 inhibiting an image, which is input by said image input 
means and is stored, from being published, 



wherein an image that satisfies the condition set 
by said setting means is determined not to be published, 
and is excluded from images to be submitted. 

53. The apparatus according to claim 52, wherein 
5 submission means submits a document to a document 

browsing server provided on the network, and updates an 
old document present on the server. 

54. The apparatus according to claim 52, wherein said 
setting means sets a publication inhibition time band 

10 together with the schedule information. 

55. The apparatus according to claim 52, wherein said 
setting means sets conditions in units of image sensing 
positions together with the schedule information. 

56. The apparatus according to claim 52, wherein 

15 control means saves each obtained image in said image 
storage means in association with an image sensing 
position and time. 

57. The apparatus according to claim 52, wherein 
submission means checks if a document to be submitted 

20 includes an image which is set not to be published by 
said setting means, and substitutes that image by 
predetermined information if such image is found. 

58. The apparatus according to claim 52, further 
comprising authentication means for authenticating 

25 submission of a created candidate document, and 
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submission means for, when an authentication 
process of said authentication means is not done after 
a predetermined time has passed, determining the 
candidate document as an authentic document to be 
5 submitted onto the network, and submitting the 
determined document. 

59. A method of controlling an information processing 
apparatus which has image input means and submits 
document information including an image via a network, 
10 comprising: 

the schedule storage step of storing input 
schedule information of the image input means; 

the image storage step of storing an image 
obtained in accordance with the schedule information; 
15 the document creation step of creating new 

document information by substituting an image in the 
document information by the image stored in the image 
storage step; and 

the setting step of setting a condition for 
20 inhibiting an image, which is input by the image input 
means and is stored, from being published, 

wherein an image that satisfies the condition set 
in the setting step is determined not to be published, 
and is excluded from images to be submitted. 
25 60. A storage medium that stores a program code for 
an information processing apparatus which has image 
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input means and submits document information including 
an image via a network, storing: 

a program code of the schedule storage step of 
storing input schedule information of the image input 
5 means ; 

a program code of the image storage step of 
storing an image obtained in accordance with the 
schedule information; 

a program code of the document creation step of 
10 creating new document information by substituting an 
image in the document information by the image stored 
in the image storage step; and 

a program code of the setting step of setting a 
condition for inhibiting an image, which is input by 
15 the image input means and is stored, from being 
published, 

wherein an image that satisfies the condition set 
in the setting step is determined not to be published, 
and is excluded from images to be submitted. 
20 61. An information processing apparatus for updating 
an image in document information to be submitted via a 
network, comprising: 

video input means capable of remote-controlling 
an image sensing position; 
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schedule storage means for storing schedule 
information having an image sensing position and time 
of said video input means; 

control means for activating said video input 
5 means in accordance with the schedule information 

stored in said schedule storage means, and saving an 
obtained image in predetermined image storage means; 

document creation means for creating new document 
information with reference to old document information 
10 on the basis of the image stored in the image storage 
means ; 

submission means for, when an authentication 
process is not done for a created candidate document 
after a predetermined time has passed, determining the 
15 candidate document as an authentic document to be 
submitted onto the network, and submitting the 
determined document; and 

setting means for setting a condition for 
inhibiting an image, which is input by said video input 
20 means and is stored, from being published, 

wherein an image that satisfies the condition set 
by said setting means is determined not to be published, 
and is excluded from images to be submitted. 
62. The apparatus according to claim 61, wherein said 
25 submission means submits a document to a document 



browsing server provided on the network, and updates an 
old document present on the server. 

63. The apparatus according to claim 61, wherein said 
setting means sets a publication inhibition time band 

5 together with the schedule information. 

64. The apparatus according to claim 61, wherein said 
setting means sets conditions in units of image sensing 
positions together with the schedule information. 

65. The apparatus according to claim 61, wherein said 
10 control means saves each obtained image in said image 

storage means in association with an image sensing 
position and time. 

66. The apparatus according to claim 61, wherein 
submission means checks if a document to be submitted 

15 includes an image which is set not to be published by 
said setting means, and substitutes that image by 
predetermined information if such image is found. 

67. A method of controlling an information processing 
apparatus which comprises video input means capable of 

20 remote-controlling an image sensing position and makes 
the video input means capture an image in document 
information to be submitted via a network, comprising: 

the schedule storage step of storing schedule 
information having an image sensing position and time 

2 5 of the video input means; 
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the control step of activating the video input 
means in accordance with the schedule information 
stored in the schedule storage step, and saving an 
obtained image in predetermined image storage means; 
5 the document creation step of creating new 

document information with reference to old document 
information on the basis of the image stored in the 
image storage means; 

the submission step of, when an authentication 

10 process is not done for a created candidate document 

after a predetermined time has passed, determining the 
candidate document as an authentic document to be 
submitted onto the network, and submitting the 
determined document; and 

15 the setting step of setting a condition for 

inhibiting an image, which is input by the video input 
means and is stored, from being published, 

wherein an image that satisfies the condition set 
in the setting step is determined not to be published, 

20 and is excluded from images to be submitted. 

68. A storage medium that stores a computer program 
code for an information processing apparatus which 
comprises video input means capable of 

remote-controlling an image sensing position and makes 
25 the video input means capture an image in document 
information to be submitted via a network, storing: 
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a program code of the schedule storage step of 
storing schedule information having an image sensing 
position and time of the video input means; 

a program code of the control step of activating 
5 the video input means in accordance with the schedule 
information stored in the schedule storage step, and 
saving an obtained image in predetermined image storage 
means ; 

a program code of the document creation step of 
10 creating new document information with reference to old 
document information on the basis of the image stored 
in the image storage means; 

a program code of the submission step of, when an 
authentication process is not done for a created 
15 candidate document after a predetermined time has 
passed, determining the candidate document as an 
authentic document to be submitted onto the network, 
and submitting the determined document; and 

a program code of the setting step of setting a 
20 condition for inhibiting an image, which is input by 
the video input means and is stored, from being 
published, 

wherein an image that satisfies the condition set 
in the setting step is determined not to be published, 
25 and is excluded from images to be submitted. 
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ABSTRACT OF THE DISCLOSURE 
This invention allows easy update of an image to 
be included in a document which is submitted on the 
network. For this purpose, data that set the image 
5 sensing times and image sensing states of a camera 
(111) the pan angle, tilt angle, and zoom ratio of 
which can be varied, are stored in an HD (106) . If one 
of the stored times has been reached, image sensing is 
done in accordance with the set contents, and the 

10 obtained image is stored in the HD (106) . Upon 

launching a candidate edit program, an old document 
inserted with images is displayed on a CRT (103) . When 
a desired image is designated, it is substituted by a 
new, sensed image candidate corresponding to that 

15 designation position. The created document is then 
uploaded to a WWW server. 
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